2024-05-14T15:02:14.855 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T15:02:14.855 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883 --owner scheduled_vshankar@teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls} --name vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/orig.config.yaml 2024-05-14T15:02:14.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T15:02:14.999 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883 branch: wip-vshankar-testing-20240509.053109-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls} email: vshankar@redhat.com first_in_suite: false job_id: '7705883' kernel: flavor: default kdb: true sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240509.053109-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Reduced data availability - Degraded data redundancy sha1: e2b755a64f0d72176b57299d02e880cf0620d780 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e2b755a64f0d72176b57299d02e880cf0620d780 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240509.053109-debug sha1: e2b755a64f0d72176b57299d02e880cf0620d780 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6285 sha1: e2b755a64f0d72176b57299d02e880cf0620d780 sleep_before_teardown: 0 subset: 548/1024 suite: fs suite_branch: wip-vshankar-testing-20240509.053109-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b755a64f0d72176b57299d02e880cf0620d780 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJDctHgxwxwdmTHmBMSuDYiAAHjOFRysYfTeXT88sKgqy1bX5giYi4SFsduoFT5no2/y3ZbUrKY3Zxl6V9tuoHk= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5vZrVO7H7YxUnZ537Mogs9gMThAxjOPrnTcNUpN6OpwsCfy8kYIFO1uRdyTD6lftYqIX6Exc1Ke+NKu2ixNzc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_07:04:04 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T15:02:15.000 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa; will attempt to use it 2024-05-14T15:02:15.000 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks 2024-05-14T15:02:15.000 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T15:02:15.002 INFO:teuthology.task.internal:Checking packages... 2024-05-14T15:02:15.025 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b755a64f0d72176b57299d02e880cf0620d780' 2024-05-14T15:02:15.025 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T15:02:15.025 INFO:teuthology.packaging:ref: None 2024-05-14T15:02:15.025 INFO:teuthology.packaging:tag: None 2024-05-14T15:02:15.026 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240509.053109-debug 2024-05-14T15:02:15.026 INFO:teuthology.packaging:sha1: e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:02:15.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240509.053109-debug 2024-05-14T15:02:15.170 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3588.ge2b755a6 2024-05-14T15:02:15.171 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T15:02:15.178 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T15:02:15.178 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T15:02:15.214 INFO:teuthology.task.internal:Saving configuration 2024-05-14T15:02:15.231 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T15:02:15.236 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T15:02:15.261 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:57:07.050153', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJDctHgxwxwdmTHmBMSuDYiAAHjOFRysYfTeXT88sKgqy1bX5giYi4SFsduoFT5no2/y3ZbUrKY3Zxl6V9tuoHk='} 2024-05-14T15:02:15.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:57:07.048192', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5vZrVO7H7YxUnZ537Mogs9gMThAxjOPrnTcNUpN6OpwsCfy8kYIFO1uRdyTD6lftYqIX6Exc1Ke+NKu2ixNzc='} 2024-05-14T15:02:15.284 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T15:02:15.290 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-14T15:02:15.290 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-14T15:02:15.290 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T15:02:15.376 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b38f87f70>, signals=[15]) 2024-05-14T15:02:15.377 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T15:02:15.383 INFO:teuthology.task.internal:Opening connections... 2024-05-14T15:02:15.383 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:02:15.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:02:15.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:02:15.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:02:15.532 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T15:02:15.538 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-05-14T15:02:15.556 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-05-14T15:02:15.556 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-05-14T15:02:15.613 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T15:02:15.614 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T15:02:15.615 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T15:02:15.615 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-05-14T15:02:15.645 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-05-14T15:02:15.662 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-05-14T15:02:15.663 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T15:02:15.720 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T15:02:15.721 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-05-14T15:02:15.745 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T15:02:15.753 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T15:02:15.773 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T15:02:15.773 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-05-14T15:02:15.775 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2024-05-14T15:02:15.791 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T15:02:15.796 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T15:02:15.796 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-05-14T15:02:15.832 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2024-05-14T15:02:15.860 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T15:02:15.916 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T15:02:15.933 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'} 2024-05-14T15:02:15.934 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, timeout 300 2024-05-14T15:02:15.934 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T15:02:15.934 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T15:02:15.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:02:15.951 DEBUG:teuthology.task.kernel:sha1 for mon.b is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:15.951 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T15:02:15.951 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2024-05-14T15:02:15.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:02:15.952 DEBUG:teuthology.task.kernel:sha1 for mon.a is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:15.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T15:02:15.952 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-05-14T15:02:16.008 INFO:teuthology.orchestra.run.smithi156.stdout:5.14.0-437.el9.x86_64 2024-05-14T15:02:16.008 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:16.008 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T15:02:16.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:16.012 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-437.el9.x86_64 2024-05-14T15:02:16.012 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:16.012 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T15:02:16.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:16.229 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum upgrade -y linux-firmware 2024-05-14T15:02:16.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2024-05-14T15:02:18.475 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-14T15:02:18.766 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.1 MB 00:00 2024-05-14T15:02:20.350 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-14T15:02:20.618 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-14T15:02:24.659 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-14T15:02:26.090 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-14T15:02:26.318 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-05-14T15:02:27.719 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-05-14T15:02:28.671 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-05-14T15:02:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 21 MB 00:02 2024-05-14T15:02:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-05-14T15:02:34.853 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-14T15:02:35.802 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-05-14T15:02:35.803 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-05-14T15:02:35.803 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-05-14T15:02:35.918 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T15:02:35.919 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:36.149 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T15:02:36.150 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T15:02:36.153 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi156.front.sepia.ceph.com to complete... 2024-05-14T15:02:37.024 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-05-14T15:02:37.025 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-05-14T15:02:37.025 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-05-14T15:02:37.134 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T15:02:37.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T15:02:37.278 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T15:02:37.278 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T15:02:37.280 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2024-05-14T15:02:54.430 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14 15:02:54 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T15:02:54.431 INFO:teuthology.orchestra.run.smithi156.stderr:FINISHED --2024-05-14 15:02:54-- 2024-05-14T15:02:54.431 INFO:teuthology.orchestra.run.smithi156.stderr:Total wall clock time: 18s 2024-05-14T15:02:54.431 INFO:teuthology.orchestra.run.smithi156.stderr:Downloaded: 1 files, 341M in 18s (19.0 MB/s) 2024-05-14T15:02:54.434 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T15:02:54.434 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T15:02:56.572 INFO:teuthology.orchestra.run.smithi156.stdout:Verifying... ######################################## 2024-05-14T15:02:56.708 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing... ######################################## 2024-05-14T15:02:56.830 INFO:teuthology.orchestra.run.smithi156.stdout:Updating / installing... 2024-05-14T15:03:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T15:03:35.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14 15:03:35 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T15:03:35.737 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2024-05-14 15:03:35-- 2024-05-14T15:03:35.738 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 58s 2024-05-14T15:03:35.738 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 341M in 58s (5.88 MB/s) 2024-05-14T15:03:35.741 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T15:03:35.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T15:03:37.930 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2024-05-14T15:03:38.110 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2024-05-14T15:03:38.241 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2024-05-14T15:03:44.260 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T15:03:44.261 DEBUG:teuthology.orchestra.run.smithi156:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T15:03:44.341 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.341 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T15:03:44.342 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T15:03:44.343 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T15:03:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T15:03:44.345 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T15:03:44.346 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T15:03:44.347 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T15:03:44.348 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T15:03:44.349 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T15:03:44.350 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T15:03:44.351 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T15:03:44.352 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T15:03:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T15:03:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T15:03:44.355 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T15:03:44.356 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T15:03:44.357 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T15:03:44.358 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T15:03:44.359 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T15:03:44.360 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T15:03:44.361 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T15:03:44.362 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T15:03:44.363 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T15:03:44.364 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T15:03:44.365 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T15:03:44.366 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T15:03:44.367 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T15:03:44.368 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T15:03:44.369 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T15:03:44.370 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T15:03:44.371 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T15:03:44.372 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T15:03:44.373 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T15:03:44.374 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T15:03:44.375 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T15:03:44.376 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T15:03:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T15:03:44.378 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T15:03:44.379 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T15:03:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T15:03:44.381 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T15:03:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T15:03:44.383 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T15:03:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T15:03:44.385 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T15:03:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T15:03:44.387 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T15:03:44.388 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T15:03:44.389 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T15:03:44.390 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T15:03:44.391 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T15:03:44.392 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T15:03:44.393 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T15:03:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T15:03:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T15:03:44.396 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T15:03:44.397 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T15:03:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T15:03:44.399 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T15:03:44.400 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T15:03:44.401 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T15:03:44.402 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T15:03:44.403 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T15:03:44.404 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T15:03:44.405 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T15:03:44.406 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T15:03:44.407 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T15:03:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T15:03:44.409 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T15:03:44.410 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T15:03:44.411 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T15:03:44.412 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T15:03:44.413 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T15:03:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T15:03:44.415 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T15:03:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T15:03:44.417 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T15:03:44.418 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T15:03:44.419 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T15:03:44.420 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T15:03:44.421 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T15:03:44.422 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T15:03:44.423 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T15:03:44.424 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T15:03:44.425 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T15:03:44.426 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T15:03:44.427 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T15:03:44.428 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T15:03:44.429 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T15:03:44.430 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T15:03:44.431 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T15:03:44.432 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T15:03:44.433 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T15:03:44.434 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T15:03:44.435 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T15:03:44.436 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T15:03:44.437 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T15:03:44.438 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T15:03:44.439 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T15:03:44.440 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T15:03:44.441 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T15:03:44.442 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T15:03:44.443 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T15:03:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T15:03:44.445 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T15:03:44.446 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T15:03:44.447 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T15:03:44.448 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T15:03:44.449 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T15:03:44.450 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T15:03:44.451 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T15:03:44.452 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T15:03:44.453 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T15:03:44.454 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T15:03:44.455 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T15:03:44.456 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T15:03:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T15:03:44.458 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T15:03:44.459 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T15:03:44.460 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T15:03:44.461 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T15:03:44.462 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T15:03:44.463 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T15:03:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T15:03:44.465 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T15:03:44.466 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T15:03:44.467 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T15:03:44.468 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T15:03:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T15:03:44.470 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T15:03:44.471 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T15:03:44.472 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T15:03:44.473 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T15:03:44.477 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.478 DEBUG:teuthology.orchestra.run.smithi156:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout:for file in vmlinuz System.map config; do 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T15:03:44.500 INFO:teuthology.orchestra.run.smithi156.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout: fi 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:done 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T15:03:44.501 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.502 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-05-14T15:03:44.502 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.06 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 68.el9 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Group : Unspecified 2024-05-14T15:03:44.575 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 8264254 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : builder@centos.org 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:03:44.576 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T15:03:44.577 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T15:03:44.577 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T15:03:44.577 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2024-05-14T15:03:44.577 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:03:44.577 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T15:03:44.578 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T15:03:44.578 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:44.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T15:03:45.170 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2024-05-14T15:03:46.527 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T15:03:46.534 INFO:teuthology.orchestra.run.smithi156.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T15:03:46.568 INFO:teuthology.orchestra.run.smithi156.stderr:done 2024-05-14T15:03:46.570 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-05-14T15:03:46.585 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.tB7AYIjqFi 2024-05-14T15:03:46.585 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tB7AYIjqFi 2024-05-14T15:03:46.652 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.tB7AYIjqFi 2024-05-14T15:03:46.791 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.tB7AYIjqFi is 6KB 2024-05-14T15:03:46.839 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.tB7AYIjqFi 2024-05-14T15:03:46.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T15:03:46.917 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T15:03:46.917 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T15:03:46.917 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T15:03:46.918 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T15:03:46.919 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:03:47.070 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2024-05-14T15:04:17.077 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-14T15:04:17.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-05-14T15:04:17.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:04:24.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T15:04:24.285 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T15:04:24.373 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T15:04:24.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T15:04:24.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T15:04:24.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T15:04:24.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T15:04:24.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T15:04:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T15:04:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T15:04:24.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T15:04:24.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T15:04:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T15:04:24.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T15:04:24.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T15:04:24.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T15:04:24.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T15:04:24.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T15:04:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T15:04:24.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T15:04:24.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T15:04:24.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T15:04:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T15:04:24.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T15:04:24.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T15:04:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T15:04:24.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T15:04:24.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T15:04:24.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T15:04:24.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T15:04:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T15:04:24.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T15:04:24.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T15:04:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T15:04:24.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T15:04:24.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T15:04:24.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T15:04:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T15:04:24.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T15:04:24.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T15:04:24.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T15:04:24.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T15:04:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T15:04:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T15:04:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T15:04:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T15:04:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T15:04:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T15:04:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T15:04:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T15:04:24.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T15:04:24.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T15:04:24.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T15:04:24.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T15:04:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T15:04:24.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T15:04:24.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T15:04:24.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T15:04:24.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T15:04:24.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T15:04:24.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T15:04:24.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T15:04:24.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T15:04:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T15:04:24.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T15:04:24.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T15:04:24.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T15:04:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T15:04:24.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T15:04:24.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T15:04:24.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T15:04:24.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T15:04:24.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T15:04:24.444 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T15:04:24.445 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T15:04:24.446 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T15:04:24.447 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T15:04:24.448 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T15:04:24.449 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T15:04:24.450 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T15:04:24.451 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T15:04:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T15:04:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T15:04:24.454 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T15:04:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T15:04:24.456 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T15:04:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T15:04:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T15:04:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T15:04:24.460 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T15:04:24.461 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T15:04:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T15:04:24.463 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T15:04:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T15:04:24.465 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T15:04:24.466 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T15:04:24.467 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T15:04:24.468 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T15:04:24.469 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T15:04:24.470 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T15:04:24.471 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T15:04:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T15:04:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T15:04:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T15:04:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T15:04:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T15:04:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T15:04:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T15:04:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T15:04:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T15:04:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T15:04:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T15:04:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T15:04:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T15:04:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T15:04:24.486 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T15:04:24.487 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T15:04:24.488 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T15:04:24.489 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T15:04:24.490 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T15:04:24.491 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T15:04:24.492 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T15:04:24.493 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T15:04:24.494 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T15:04:24.495 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T15:04:24.496 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T15:04:24.497 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T15:04:24.498 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T15:04:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T15:04:24.500 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T15:04:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T15:04:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T15:04:24.503 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T15:04:24.504 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T15:04:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T15:04:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T15:04:24.507 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T15:04:24.508 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T15:04:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T15:04:24.510 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T15:04:24.511 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T15:04:24.512 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T15:04:24.513 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T15:04:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T15:04:24.515 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T15:04:24.516 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T15:04:24.517 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T15:04:24.518 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T15:04:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T15:04:24.520 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T15:04:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T15:04:24.522 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T15:04:24.523 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T15:04:24.524 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T15:04:24.525 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T15:04:24.526 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T15:04:24.527 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T15:04:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T15:04:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T15:04:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T15:04:24.531 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T15:04:24.532 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T15:04:24.533 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T15:04:24.534 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T15:04:24.535 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T15:04:24.536 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T15:04:24.537 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T15:04:24.538 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T15:04:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T15:04:24.540 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T15:04:24.541 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T15:04:24.545 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.545 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T15:04:24.568 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T15:04:24.568 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout:for file in vmlinuz System.map config; do 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: fi 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T15:04:24.569 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-05-14T15:04:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T15:04:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T15:04:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.570 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-05-14T15:04:24.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-05-14T15:04:24.655 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-05-14T15:04:24.655 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-05-14T15:04:24.655 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-05-14T15:04:24.656 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:04:24.657 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T15:04:24.658 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T15:04:24.658 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:24.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T15:04:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-05-14T15:04:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T15:04:26.670 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-05-14T15:04:26.673 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-05-14T15:04:26.702 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.8usRYtIc5G 2024-05-14T15:04:26.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8usRYtIc5G 2024-05-14T15:04:26.776 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.8usRYtIc5G 2024-05-14T15:04:26.918 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.8usRYtIc5G is 6KB 2024-05-14T15:04:26.966 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.8usRYtIc5G 2024-05-14T15:04:26.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T15:04:27.043 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T15:04:27.044 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T15:04:27.044 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T15:04:27.044 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T15:04:27.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:04:27.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-05-14T15:04:51.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-05-14T15:04:57.202 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-14T15:04:57.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-05-14T15:04:57.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:05:00.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-05-14T15:05:00.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:05:32.526 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-05-14T15:05:33.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-05-14T15:05:33.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T15:05:33.220 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2024-05-14T15:05:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:05:33.275 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:05:33.275 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T15:05:33.275 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T15:05:34.276 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-14T15:05:34.276 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2024-05-14T15:05:34.433 DEBUG:teuthology.parallel:result is None 2024-05-14T15:05:57.206 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T15:06:06.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-05-14T15:06:06.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:06:08.680 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-05-14T15:06:09.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-05-14T15:06:09.521 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T15:06:09.521 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-05-14T15:06:09.563 INFO:teuthology.orchestra.run.smithi002.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:06:09.563 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T15:06:09.563 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T15:06:09.564 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T15:06:10.564 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-14T15:06:10.565 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T15:06:10.706 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-05-14T15:06:10.760 DEBUG:teuthology.parallel:result is None 2024-05-14T15:06:10.760 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T15:06:10.769 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T15:06:10.769 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T15:06:10.775 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T15:06:10.835 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T15:06:10.842 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T15:06:10.873 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T15:06:10.873 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T15:06:10.878 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T15:06:10.947 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T15:06:10.963 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T15:06:10.964 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T15:06:10.971 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T15:06:11.057 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T15:06:11.072 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T15:06:11.090 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T15:06:11.104 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T15:06:11.109 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T15:06:11.117 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T15:06:11.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T15:06:11.123 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T15:06:11.211 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T15:06:11.221 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T15:06:11.221 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T15:06:11.229 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T15:06:11.281 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T15:06:11.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T15:06:11.473 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T15:06:11.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T15:06:11.631 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:06:11.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T15:06:11.706 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T15:06:11.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T15:06:11.895 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T15:06:11.983 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T15:06:12.067 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:06:12.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T15:06:12.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-05-14T15:06:12.155 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2024-05-14T15:06:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T15:06:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T15:06:12.502 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T15:06:12.510 INFO:teuthology.task.internal:Starting timer... 2024-05-14T15:06:12.510 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T15:06:12.543 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T15:06:12.577 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-14T15:06:12.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-05-14T15:06:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-05-14T15:06:12.679 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2024-05-14T15:06:12.826 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2024-05-14T15:06:12.831 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T15:06:12.831 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-05-14T15:06:12.887 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-05-14T15:06:12.887 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2024-05-14T15:06:12.939 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2024-05-14T15:06:12.939 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive'} 2024-05-14T15:06:12.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T15:06:13.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:06:13.011 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T15:06:13.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:06:13.091 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T15:06:13.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-05-14T15:06:13.167 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2024-05-14T15:06:13.236 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T15:06:13.245 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-14T15:06:13.251 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-14T15:06:13.368 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T15:06:13.383 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T15:06:13.385 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T15:12:22.562 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2024-05-14T15:12:22.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-05-14T15:12:22.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:12:22.677 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-05-14T15:12:22.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-05-14T15:12:22.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-05-14T15:12:22.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:12:22.950 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-05-14T15:12:23.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-05-14T15:12:23.100 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T15:12:23.111 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T15:12:23.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T15:12:23.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:12:23.120 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T15:12:23.120 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:12:23.207 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T15:12:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T15:12:23.246 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T15:12:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T15:12:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2024-05-14T15:12:23.337 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-05-14T15:12:23.347 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2024-05-14T15:12:23.373 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-05-14T15:12:23.387 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T15:12:23.419 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T15:12:23.428 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T15:12:23.468 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T15:12:23.566 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:12:23.574 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:12:23.574 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-05-14T15:12:23.574 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.575 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.575 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.575 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:12:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:12:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-05-14T15:12:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:12:23.627 INFO:teuthology.run_tasks:Running task install... 2024-05-14T15:12:23.635 DEBUG:teuthology.task.install:project ceph 2024-05-14T15:12:23.635 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}} 2024-05-14T15:12:23.635 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'} 2024-05-14T15:12:23.635 INFO:teuthology.task.install:Using flavor: default 2024-05-14T15:12:23.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-14T15:12:23.641 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T15:12:23.641 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T15:12:23.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:12:23.643 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T15:12:23.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:12:23.785 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T15:12:23.786 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T15:12:23.790 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T15:12:23.791 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T15:12:23.899 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T15:12:23.899 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:12:23.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T15:12:23.972 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T15:12:23.972 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:12:23.972 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T15:12:23.995 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T15:12:23.995 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T15:12:24.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T15:12:24.062 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T15:12:24.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T15:12:24.190 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T15:12:24.243 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T15:12:24.297 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T15:12:24.328 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-05-14T15:12:24.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-05-14T15:12:24.371 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2024-05-14T15:12:24.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2024-05-14T15:12:24.690 INFO:teuthology.orchestra.run.smithi002.stdout:57 files removed 2024-05-14T15:12:24.702 INFO:teuthology.orchestra.run.smithi156.stdout:57 files removed 2024-05-14T15:12:24.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T15:12:24.740 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T15:12:25.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-05-14T15:12:25.710 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 154 kB/s | 84 kB 00:00 2024-05-14T15:12:26.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-05-14T15:12:26.227 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-05-14T15:12:26.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-05-14T15:12:26.753 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-05-14T15:12:27.368 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-14T15:12:27.764 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.1 MB 00:00 2024-05-14T15:12:29.869 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-05-14T15:12:34.853 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.2 MB 00:01 2024-05-14T15:12:36.488 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-05-14T15:12:36.489 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-05-14T15:12:38.720 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-14T15:12:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-14T15:12:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-05-14T15:12:44.831 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-05-14T15:12:45.417 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 21 MB 00:02 2024-05-14T15:12:47.421 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:12:47.423 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:12:47.444 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T15:12:47.445 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T15:12:47.446 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T15:12:47.448 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:12:47.450 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T15:12:47.454 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T15:12:47.455 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T15:12:47.525 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-05-14T15:12:47.546 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================= 2024-05-14T15:12:47.546 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-05-14T15:12:47.546 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================= 2024-05-14T15:12:47.546 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T15:12:47.547 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T15:12:47.548 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T15:12:47.549 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T15:12:47.550 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T15:12:47.551 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T15:12:47.552 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T15:12:47.553 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T15:12:47.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T15:12:47.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T15:12:47.556 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================= 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout:Install 148 Packages 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 8 Packages 2024-05-14T15:12:47.557 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:12:47.558 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 219 M 2024-05-14T15:12:47.558 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-05-14T15:12:48.466 INFO:teuthology.orchestra.run.smithi156.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-14T15:12:48.725 INFO:teuthology.orchestra.run.smithi156.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 3.3 MB/s | 863 kB 00:00 2024-05-14T15:12:48.799 INFO:teuthology.orchestra.run.smithi156.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 2.0 MB/s | 147 kB 00:00 2024-05-14T15:12:49.125 INFO:teuthology.orchestra.run.smithi156.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 7.0 MB/s | 2.3 MB 00:00 2024-05-14T15:12:49.333 INFO:teuthology.orchestra.run.smithi156.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-05-14T15:12:50.092 INFO:teuthology.orchestra.run.smithi156.stdout:(6/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 6.4 MB/s | 4.9 MB 00:00 2024-05-14T15:12:50.217 INFO:teuthology.orchestra.run.smithi156.stdout:(7/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 2.7 MB/s | 5.4 MB 00:02 2024-05-14T15:12:51.775 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-05-14T15:12:52.584 INFO:teuthology.orchestra.run.smithi156.stdout:(8/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x86 7.1 MB/s | 18 MB 00:02 2024-05-14T15:12:52.659 INFO:teuthology.orchestra.run.smithi156.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 340 kB/s | 25 kB 00:00 2024-05-14T15:12:54.485 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:12:54.487 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:12:54.509 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T15:12:54.510 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T15:12:54.511 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T15:12:54.513 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:12:54.515 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T15:12:54.519 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T15:12:54.520 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T15:12:54.596 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T15:12:54.617 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T15:12:54.618 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T15:12:54.619 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-05-14T15:12:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T15:12:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T15:12:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T15:12:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T15:12:54.624 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T15:12:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T15:12:54.626 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T15:12:54.627 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-05-14T15:12:54.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:12:54.629 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 219 M 2024-05-14T15:12:54.629 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-05-14T15:12:55.084 INFO:teuthology.orchestra.run.smithi156.stdout:(10/156): ceph-common-19.0.0-3588.ge2b755a6.el9 2.8 MB/s | 20 MB 00:06 2024-05-14T15:12:55.243 INFO:teuthology.orchestra.run.smithi156.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 1.4 MB/s | 224 kB 00:00 2024-05-14T15:12:55.351 INFO:teuthology.orchestra.run.smithi156.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 252 kB/s | 27 kB 00:00 2024-05-14T15:12:55.418 INFO:teuthology.orchestra.run.smithi156.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 482 kB/s | 32 kB 00:00 2024-05-14T15:12:55.427 INFO:teuthology.orchestra.run.smithi002.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-14T15:12:55.794 INFO:teuthology.orchestra.run.smithi156.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 2.0 MB/s | 756 kB 00:00 2024-05-14T15:12:55.919 INFO:teuthology.orchestra.run.smithi156.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.2 MB/s | 157 kB 00:00 2024-05-14T15:12:56.036 INFO:teuthology.orchestra.run.smithi156.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.1 MB/s | 127 kB 00:00 2024-05-14T15:12:56.336 INFO:teuthology.orchestra.run.smithi156.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 1.6 MB/s | 497 kB 00:00 2024-05-14T15:12:56.402 INFO:teuthology.orchestra.run.smithi002.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 886 kB/s | 863 kB 00:00 2024-05-14T15:12:56.560 INFO:teuthology.orchestra.run.smithi002.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 933 kB/s | 147 kB 00:00 2024-05-14T15:12:58.028 INFO:teuthology.orchestra.run.smithi156.stdout:(18/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 1.3 MB/s | 10 MB 00:07 2024-05-14T15:12:58.153 INFO:teuthology.orchestra.run.smithi156.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 364 kB/s | 45 kB 00:00 2024-05-14T15:12:58.520 INFO:teuthology.orchestra.run.smithi156.stdout:(20/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 2.4 MB/s | 5.2 MB 00:02 2024-05-14T15:12:58.554 INFO:teuthology.orchestra.run.smithi156.stdout:(21/156): python3-ceph-common-19.0.0-3588.ge2b7 339 kB/s | 135 kB 00:00 2024-05-14T15:12:58.586 INFO:teuthology.orchestra.run.smithi002.stdout:(4/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-05-14T15:12:58.620 INFO:teuthology.orchestra.run.smithi156.stdout:(22/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.6 MB/s | 162 kB 00:00 2024-05-14T15:12:58.644 INFO:teuthology.orchestra.run.smithi002.stdout:(5/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 1.1 MB/s | 2.3 MB 00:02 2024-05-14T15:12:58.813 INFO:teuthology.orchestra.run.smithi156.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 301 kB 00:00 2024-05-14T15:12:58.954 INFO:teuthology.orchestra.run.smithi156.stdout:(24/156): python3-rados-19.0.0-3588.ge2b755a6.e 803 kB/s | 321 kB 00:00 2024-05-14T15:12:59.072 INFO:teuthology.orchestra.run.smithi156.stdout:(25/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 387 kB/s | 100 kB 00:00 2024-05-14T15:12:59.180 INFO:teuthology.orchestra.run.smithi156.stdout:(26/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 383 kB/s | 86 kB 00:00 2024-05-14T15:12:59.389 INFO:teuthology.orchestra.run.smithi156.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 818 kB/s | 170 kB 00:00 2024-05-14T15:12:59.498 INFO:teuthology.orchestra.run.smithi156.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 316 kB/s | 34 kB 00:00 2024-05-14T15:12:59.519 INFO:teuthology.orchestra.run.smithi002.stdout:(6/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-14T15:12:59.673 INFO:teuthology.orchestra.run.smithi156.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 817 kB/s | 142 kB 00:00 2024-05-14T15:13:00.207 INFO:teuthology.orchestra.run.smithi156.stdout:(30/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 2.7 MB/s | 3.0 MB 00:01 2024-05-14T15:13:00.236 INFO:teuthology.orchestra.run.smithi002.stdout:(7/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 3.1 MB/s | 4.9 MB 00:01 2024-05-14T15:13:01.124 INFO:teuthology.orchestra.run.smithi156.stdout:(31/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 5.1 MB/s | 43 MB 00:08 2024-05-14T15:13:01.324 INFO:teuthology.orchestra.run.smithi156.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 1.3 MB/s | 274 kB 00:00 2024-05-14T15:13:01.408 INFO:teuthology.orchestra.run.smithi156.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 599 kB/s | 49 kB 00:00 2024-05-14T15:13:01.483 INFO:teuthology.orchestra.run.smithi156.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 222 kB/s | 16 kB 00:00 2024-05-14T15:13:01.575 INFO:teuthology.orchestra.run.smithi156.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.9 MB/s | 273 kB 00:00 2024-05-14T15:13:01.742 INFO:teuthology.orchestra.run.smithi156.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-14T15:13:01.800 INFO:teuthology.orchestra.run.smithi156.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 318 kB/s | 18 kB 00:00 2024-05-14T15:13:01.809 INFO:teuthology.orchestra.run.smithi002.stdout:(8/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 2.9 MB/s | 20 MB 00:06 2024-05-14T15:13:01.850 INFO:teuthology.orchestra.run.smithi156.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-05-14T15:13:01.887 INFO:teuthology.orchestra.run.smithi002.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 328 kB/s | 25 kB 00:00 2024-05-14T15:13:01.959 INFO:teuthology.orchestra.run.smithi156.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2024-05-14T15:13:02.076 INFO:teuthology.orchestra.run.smithi156.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-14T15:13:02.151 INFO:teuthology.orchestra.run.smithi156.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-14T15:13:02.294 INFO:teuthology.orchestra.run.smithi156.stdout:(42/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 1.4 MB/s | 3.5 MB 00:02 2024-05-14T15:13:02.385 INFO:teuthology.orchestra.run.smithi156.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 5.3 MB/s | 1.2 MB 00:00 2024-05-14T15:13:02.410 INFO:teuthology.orchestra.run.smithi156.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 921 kB/s | 106 kB 00:00 2024-05-14T15:13:02.529 INFO:teuthology.orchestra.run.smithi002.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 4.4 MB/s | 10 MB 00:02 2024-05-14T15:13:02.552 INFO:teuthology.orchestra.run.smithi156.stdout:(45/156): ceph-mgr-diskprediction-local-19.0.0- 3.1 MB/s | 7.4 MB 00:02 2024-05-14T15:13:02.587 INFO:teuthology.orchestra.run.smithi002.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 3.8 MB/s | 224 kB 00:00 2024-05-14T15:13:02.594 INFO:teuthology.orchestra.run.smithi156.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 650 kB/s | 135 kB 00:00 2024-05-14T15:13:02.654 INFO:teuthology.orchestra.run.smithi002.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 411 kB/s | 27 kB 00:00 2024-05-14T15:13:02.661 INFO:teuthology.orchestra.run.smithi156.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 499 kB/s | 125 kB 00:00 2024-05-14T15:13:02.703 INFO:teuthology.orchestra.run.smithi156.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-05-14T15:13:02.713 INFO:teuthology.orchestra.run.smithi002.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 553 kB/s | 32 kB 00:00 2024-05-14T15:13:02.905 INFO:teuthology.orchestra.run.smithi002.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 3.9 MB/s | 756 kB 00:00 2024-05-14T15:13:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 3.1 MB/s | 157 kB 00:00 2024-05-14T15:13:02.970 INFO:teuthology.orchestra.run.smithi156.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 402 kB/s | 107 kB 00:00 2024-05-14T15:13:03.033 INFO:teuthology.orchestra.run.smithi002.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.6 MB/s | 127 kB 00:00 2024-05-14T15:13:03.054 INFO:teuthology.orchestra.run.smithi156.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 259 kB/s | 21 kB 00:00 2024-05-14T15:13:03.172 INFO:teuthology.orchestra.run.smithi002.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 3.5 MB/s | 497 kB 00:00 2024-05-14T15:13:03.262 INFO:teuthology.orchestra.run.smithi156.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-05-14T15:13:03.296 INFO:teuthology.orchestra.run.smithi156.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2024-05-14T15:13:03.338 INFO:teuthology.orchestra.run.smithi156.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 438 kB/s | 33 kB 00:00 2024-05-14T15:13:03.405 INFO:teuthology.orchestra.run.smithi156.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-05-14T15:13:03.431 INFO:teuthology.orchestra.run.smithi156.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 199 kB/s | 18 kB 00:00 2024-05-14T15:13:03.481 INFO:teuthology.orchestra.run.smithi156.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-05-14T15:13:03.573 INFO:teuthology.orchestra.run.smithi156.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 497 kB/s | 45 kB 00:00 2024-05-14T15:13:03.598 INFO:teuthology.orchestra.run.smithi156.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 962 kB/s | 160 kB 00:00 2024-05-14T15:13:03.832 INFO:teuthology.orchestra.run.smithi156.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-05-14T15:13:03.866 INFO:teuthology.orchestra.run.smithi156.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 2.1 MB/s | 582 kB 00:00 2024-05-14T15:13:03.891 INFO:teuthology.orchestra.run.smithi156.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 441 kB/s | 25 kB 00:00 2024-05-14T15:13:03.925 INFO:teuthology.orchestra.run.smithi156.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 821 kB/s | 47 kB 00:00 2024-05-14T15:13:04.000 INFO:teuthology.orchestra.run.smithi156.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.3 MB/s | 3.0 MB 00:00 2024-05-14T15:13:04.033 INFO:teuthology.orchestra.run.smithi156.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-05-14T15:13:04.067 INFO:teuthology.orchestra.run.smithi156.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 35 kB 00:00 2024-05-14T15:13:04.164 INFO:teuthology.orchestra.run.smithi156.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 791 kB/s | 188 kB 00:00 2024-05-14T15:13:04.189 INFO:teuthology.orchestra.run.smithi002.stdout:(18/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 5.1 MB/s | 5.2 MB 00:01 2024-05-14T15:13:04.273 INFO:teuthology.orchestra.run.smithi002.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 549 kB/s | 45 kB 00:00 2024-05-14T15:13:04.340 INFO:teuthology.orchestra.run.smithi002.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 2.0 MB/s | 135 kB 00:00 2024-05-14T15:13:04.384 INFO:teuthology.orchestra.run.smithi156.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 7.2 MB/s | 1.6 MB 00:00 2024-05-14T15:13:04.415 INFO:teuthology.orchestra.run.smithi002.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 2.1 MB/s | 162 kB 00:00 2024-05-14T15:13:04.526 INFO:teuthology.orchestra.run.smithi156.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-05-14T15:13:04.532 INFO:teuthology.orchestra.run.smithi002.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 2.7 MB/s | 321 kB 00:00 2024-05-14T15:13:04.593 INFO:teuthology.orchestra.run.smithi156.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-14T15:13:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 2.7 MB/s | 301 kB 00:00 2024-05-14T15:13:04.716 INFO:teuthology.orchestra.run.smithi002.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.3 MB/s | 100 kB 00:00 2024-05-14T15:13:04.783 INFO:teuthology.orchestra.run.smithi002.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-14T15:13:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 5.7 MB/s | 4.7 MB 00:00 2024-05-14T15:13:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-05-14T15:13:05.019 INFO:teuthology.orchestra.run.smithi156.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-14T15:13:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-05-14T15:13:05.178 INFO:teuthology.orchestra.run.smithi156.stdout:(74/156): postgresql-server-13.14-1.el9.x86_64. 9.9 MB/s | 5.8 MB 00:00 2024-05-14T15:13:05.211 INFO:teuthology.orchestra.run.smithi156.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-05-14T15:13:05.245 INFO:teuthology.orchestra.run.smithi156.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-05-14T15:13:05.279 INFO:teuthology.orchestra.run.smithi156.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-05-14T15:13:05.283 INFO:teuthology.orchestra.run.smithi002.stdout:(26/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 3.1 MB/s | 18 MB 00:05 2024-05-14T15:13:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 331 kB/s | 19 kB 00:00 2024-05-14T15:13:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-14T15:13:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 523 kB/s | 35 kB 00:00 2024-05-14T15:13:05.392 INFO:teuthology.orchestra.run.smithi002.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.5 MB/s | 170 kB 00:00 2024-05-14T15:13:05.438 INFO:teuthology.orchestra.run.smithi156.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-14T15:13:05.500 INFO:teuthology.orchestra.run.smithi002.stdout:(28/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 4.2 MB/s | 3.0 MB 00:00 2024-05-14T15:13:05.522 INFO:teuthology.orchestra.run.smithi156.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-05-14T15:13:05.526 INFO:teuthology.orchestra.run.smithi002.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3588.g 258 kB/s | 34 kB 00:00 2024-05-14T15:13:05.559 INFO:teuthology.orchestra.run.smithi002.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 2.4 MB/s | 142 kB 00:00 2024-05-14T15:13:05.606 INFO:teuthology.orchestra.run.smithi156.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 931 kB/s | 77 kB 00:00 2024-05-14T15:13:05.723 INFO:teuthology.orchestra.run.smithi156.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 8.5 MB/s | 6.0 MB 00:00 2024-05-14T15:13:05.748 INFO:teuthology.orchestra.run.smithi156.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 299 kB/s | 42 kB 00:00 2024-05-14T15:13:05.790 INFO:teuthology.orchestra.run.smithi156.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-14T15:13:05.824 INFO:teuthology.orchestra.run.smithi156.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-14T15:13:05.866 INFO:teuthology.orchestra.run.smithi156.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-05-14T15:13:05.908 INFO:teuthology.orchestra.run.smithi156.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 615 kB/s | 51 kB 00:00 2024-05-14T15:13:06.016 INFO:teuthology.orchestra.run.smithi156.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.6 MB/s | 5.1 MB 00:00 2024-05-14T15:13:06.042 INFO:teuthology.orchestra.run.smithi156.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 307 kB/s | 54 kB 00:00 2024-05-14T15:13:06.084 INFO:teuthology.orchestra.run.smithi156.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 630 kB/s | 42 kB 00:00 2024-05-14T15:13:06.109 INFO:teuthology.orchestra.run.smithi156.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 664 kB/s | 44 kB 00:00 2024-05-14T15:13:06.151 INFO:teuthology.orchestra.run.smithi156.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-14T15:13:06.160 INFO:teuthology.orchestra.run.smithi002.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 5.6 MB/s | 3.5 MB 00:00 2024-05-14T15:13:06.176 INFO:teuthology.orchestra.run.smithi156.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-05-14T15:13:06.218 INFO:teuthology.orchestra.run.smithi156.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 714 kB/s | 47 kB 00:00 2024-05-14T15:13:06.260 INFO:teuthology.orchestra.run.smithi002.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.7 MB/s | 274 kB 00:00 2024-05-14T15:13:06.260 INFO:teuthology.orchestra.run.smithi156.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-14T15:13:06.285 INFO:teuthology.orchestra.run.smithi156.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 875 kB/s | 58 kB 00:00 2024-05-14T15:13:06.327 INFO:teuthology.orchestra.run.smithi156.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-05-14T15:13:06.353 INFO:teuthology.orchestra.run.smithi156.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 960 kB/s | 64 kB 00:00 2024-05-14T15:13:06.360 INFO:teuthology.orchestra.run.smithi002.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 498 kB/s | 49 kB 00:00 2024-05-14T15:13:06.395 INFO:teuthology.orchestra.run.smithi156.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-05-14T15:13:06.402 INFO:teuthology.orchestra.run.smithi002.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 403 kB/s | 16 kB 00:00 2024-05-14T15:13:06.494 INFO:teuthology.orchestra.run.smithi002.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.9 MB/s | 273 kB 00:00 2024-05-14T15:13:06.620 INFO:teuthology.orchestra.run.smithi002.stdout:(36/156): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2024-05-14T15:13:06.670 INFO:teuthology.orchestra.run.smithi002.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 373 kB/s | 18 kB 00:00 2024-05-14T15:13:06.686 INFO:teuthology.orchestra.run.smithi156.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2024-05-14T15:13:06.734 INFO:teuthology.orchestra.run.smithi002.stdout:(38/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 3.1 MB/s | 763 kB 00:00 2024-05-14T15:13:06.795 INFO:teuthology.orchestra.run.smithi002.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 647 kB/s | 80 kB 00:00 2024-05-14T15:13:06.871 INFO:teuthology.orchestra.run.smithi002.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 5.8 MB/s | 803 kB 00:00 2024-05-14T15:13:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-05-14T15:13:06.980 INFO:teuthology.orchestra.run.smithi002.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-14T15:13:07.047 INFO:teuthology.orchestra.run.smithi002.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-14T15:13:07.097 INFO:teuthology.orchestra.run.smithi002.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-05-14T15:13:07.112 INFO:teuthology.orchestra.run.smithi156.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-05-14T15:13:07.172 INFO:teuthology.orchestra.run.smithi002.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-05-14T15:13:07.198 INFO:teuthology.orchestra.run.smithi002.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-05-14T15:13:07.273 INFO:teuthology.orchestra.run.smithi002.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-05-14T15:13:07.379 INFO:teuthology.orchestra.run.smithi156.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 878 kB/s | 863 kB 00:00 2024-05-14T15:13:07.721 INFO:teuthology.orchestra.run.smithi156.stdout:(105/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-05-14T15:13:07.746 INFO:teuthology.orchestra.run.smithi156.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 53 kB/s | 19 kB 00:00 2024-05-14T15:13:07.780 INFO:teuthology.orchestra.run.smithi156.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 463 kB/s | 309 kB 00:00 2024-05-14T15:13:07.815 INFO:teuthology.orchestra.run.smithi002.stdout:(48/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 7.3 MB/s | 43 MB 00:05 2024-05-14T15:13:07.880 INFO:teuthology.orchestra.run.smithi156.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 196 kB/s | 26 kB 00:00 2024-05-14T15:13:07.898 INFO:teuthology.orchestra.run.smithi002.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 985 kB/s | 689 kB 00:00 2024-05-14T15:13:07.921 INFO:teuthology.orchestra.run.smithi156.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 344 kB/s | 49 kB 00:00 2024-05-14T15:13:07.967 INFO:teuthology.orchestra.run.smithi002.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 320 kB/s | 21 kB 00:00 2024-05-14T15:13:07.999 INFO:teuthology.orchestra.run.smithi002.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 585 kB/s | 107 kB 00:00 2024-05-14T15:13:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-05-14T15:13:08.066 INFO:teuthology.orchestra.run.smithi002.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 495 kB/s | 33 kB 00:00 2024-05-14T15:13:08.100 INFO:teuthology.orchestra.run.smithi002.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-05-14T15:13:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 314 kB/s | 18 kB 00:00 2024-05-14T15:13:08.147 INFO:teuthology.orchestra.run.smithi156.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 253 kB/s | 67 kB 00:00 2024-05-14T15:13:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 229 kB/s | 11 kB 00:00 2024-05-14T15:13:08.201 INFO:teuthology.orchestra.run.smithi002.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-14T15:13:08.226 INFO:teuthology.orchestra.run.smithi002.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 608 kB/s | 45 kB 00:00 2024-05-14T15:13:08.273 INFO:teuthology.orchestra.run.smithi156.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 432 kB/s | 151 kB 00:00 2024-05-14T15:13:08.335 INFO:teuthology.orchestra.run.smithi002.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-05-14T15:13:08.410 INFO:teuthology.orchestra.run.smithi002.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-05-14T15:13:08.431 INFO:teuthology.orchestra.run.smithi156.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-05-14T15:13:08.435 INFO:teuthology.orchestra.run.smithi002.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 256 kB/s | 25 kB 00:00 2024-05-14T15:13:08.461 INFO:teuthology.orchestra.run.smithi002.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-05-14T15:13:08.494 INFO:teuthology.orchestra.run.smithi002.stdout:(63/156): libtool-2.4.6-45.el9.x86_64.rpm 2.1 MB/s | 582 kB 00:00 2024-05-14T15:13:08.528 INFO:teuthology.orchestra.run.smithi002.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-14T15:13:08.554 INFO:teuthology.orchestra.run.smithi002.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-14T15:13:08.556 INFO:teuthology.orchestra.run.smithi156.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 351 kB/s | 43 kB 00:00 2024-05-14T15:13:08.578 INFO:teuthology.orchestra.run.smithi002.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 424 kB/s | 35 kB 00:00 2024-05-14T15:13:08.665 INFO:teuthology.orchestra.run.smithi156.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 1.4 MB/s | 548 kB 00:00 2024-05-14T15:13:08.690 INFO:teuthology.orchestra.run.smithi156.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 243 kB/s | 32 kB 00:00 2024-05-14T15:13:08.712 INFO:teuthology.orchestra.run.smithi002.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-14T15:13:08.732 INFO:teuthology.orchestra.run.smithi156.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.4 MB/s | 839 kB 00:00 2024-05-14T15:13:08.774 INFO:teuthology.orchestra.run.smithi156.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 139 kB/s | 15 kB 00:00 2024-05-14T15:13:08.846 INFO:teuthology.orchestra.run.smithi002.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-05-14T15:13:08.904 INFO:teuthology.orchestra.run.smithi002.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 4.7 MB/s | 911 kB 00:00 2024-05-14T15:13:08.938 INFO:teuthology.orchestra.run.smithi002.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-14T15:13:09.000 INFO:teuthology.orchestra.run.smithi156.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 558 kB/s | 172 kB 00:00 2024-05-14T15:13:09.055 INFO:teuthology.orchestra.run.smithi002.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-05-14T15:13:09.130 INFO:teuthology.orchestra.run.smithi002.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-05-14T15:13:09.133 INFO:teuthology.orchestra.run.smithi156.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 848 kB/s | 303 kB 00:00 2024-05-14T15:13:09.155 INFO:teuthology.orchestra.run.smithi002.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 881 kB/s | 87 kB 00:00 2024-05-14T15:13:09.200 INFO:teuthology.orchestra.run.smithi156.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 177 kB/s | 35 kB 00:00 2024-05-14T15:13:09.255 INFO:teuthology.orchestra.run.smithi002.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-05-14T15:13:09.372 INFO:teuthology.orchestra.run.smithi002.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-14T15:13:09.406 INFO:teuthology.orchestra.run.smithi002.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-05-14T15:13:09.431 INFO:teuthology.orchestra.run.smithi002.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 446 kB/s | 26 kB 00:00 2024-05-14T15:13:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 494 kB/s | 358 kB 00:00 2024-05-14T15:13:09.465 INFO:teuthology.orchestra.run.smithi002.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 331 kB/s | 19 kB 00:00 2024-05-14T15:13:09.515 INFO:teuthology.orchestra.run.smithi002.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-14T15:13:09.657 INFO:teuthology.orchestra.run.smithi002.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-05-14T15:13:09.676 INFO:teuthology.orchestra.run.smithi156.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 380 kB/s | 206 kB 00:00 2024-05-14T15:13:09.682 INFO:teuthology.orchestra.run.smithi002.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 160 kB/s | 35 kB 00:00 2024-05-14T15:13:09.716 INFO:teuthology.orchestra.run.smithi002.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-05-14T15:13:09.750 INFO:teuthology.orchestra.run.smithi002.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-14T15:13:09.751 INFO:teuthology.orchestra.run.smithi156.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 497 kB/s | 144 kB 00:00 2024-05-14T15:13:09.775 INFO:teuthology.orchestra.run.smithi002.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-14T15:13:09.776 INFO:teuthology.orchestra.run.smithi156.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-05-14T15:13:09.817 INFO:teuthology.orchestra.run.smithi002.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 640 kB/s | 42 kB 00:00 2024-05-14T15:13:09.850 INFO:teuthology.orchestra.run.smithi002.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-05-14T15:13:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-14T15:13:09.910 INFO:teuthology.orchestra.run.smithi156.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 112 kB/s | 18 kB 00:00 2024-05-14T15:13:09.934 INFO:teuthology.orchestra.run.smithi002.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-05-14T15:13:09.935 INFO:teuthology.orchestra.run.smithi156.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 147 kB/s | 23 kB 00:00 2024-05-14T15:13:09.959 INFO:teuthology.orchestra.run.smithi002.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 684 kB/s | 51 kB 00:00 2024-05-14T15:13:10.024 INFO:teuthology.orchestra.run.smithi002.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 604 kB/s | 54 kB 00:00 2024-05-14T15:13:10.027 INFO:teuthology.orchestra.run.smithi156.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.5 MB/s | 2.0 MB 00:00 2024-05-14T15:13:10.052 INFO:teuthology.orchestra.run.smithi156.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-05-14T15:13:10.178 INFO:teuthology.orchestra.run.smithi156.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 81 kB/s | 20 kB 00:00 2024-05-14T15:13:10.227 INFO:teuthology.orchestra.run.smithi002.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 207 kB/s | 42 kB 00:00 2024-05-14T15:13:10.295 INFO:teuthology.orchestra.run.smithi156.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 192 kB/s | 46 kB 00:00 2024-05-14T15:13:10.344 INFO:teuthology.orchestra.run.smithi002.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-05-14T15:13:10.378 INFO:teuthology.orchestra.run.smithi002.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 295 kB/s | 44 kB 00:00 2024-05-14T15:13:10.412 INFO:teuthology.orchestra.run.smithi156.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 339 kB/s | 79 kB 00:00 2024-05-14T15:13:10.435 INFO:teuthology.orchestra.run.smithi002.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-05-14T15:13:10.461 INFO:teuthology.orchestra.run.smithi002.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 434 kB/s | 36 kB 00:00 2024-05-14T15:13:10.479 INFO:teuthology.orchestra.run.smithi156.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-05-14T15:13:10.487 INFO:teuthology.orchestra.run.smithi002.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-05-14T15:13:10.504 INFO:teuthology.orchestra.run.smithi156.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 277 kB/s | 58 kB 00:00 2024-05-14T15:13:10.529 INFO:teuthology.orchestra.run.smithi002.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-14T15:13:10.554 INFO:teuthology.orchestra.run.smithi002.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 886 kB/s | 58 kB 00:00 2024-05-14T15:13:10.579 INFO:teuthology.orchestra.run.smithi002.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-05-14T15:13:10.605 INFO:teuthology.orchestra.run.smithi002.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-14T15:13:10.621 INFO:teuthology.orchestra.run.smithi156.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 116 kB/s | 16 kB 00:00 2024-05-14T15:13:10.630 INFO:teuthology.orchestra.run.smithi002.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-05-14T15:13:10.646 INFO:teuthology.orchestra.run.smithi156.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-05-14T15:13:10.671 INFO:teuthology.orchestra.run.smithi156.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 540 kB/s | 90 kB 00:00 2024-05-14T15:13:10.822 INFO:teuthology.orchestra.run.smithi156.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 141 kB/s | 28 kB 00:00 2024-05-14T15:13:10.847 INFO:teuthology.orchestra.run.smithi156.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 154 kB/s | 31 kB 00:00 2024-05-14T15:13:10.905 INFO:teuthology.orchestra.run.smithi002.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-05-14T15:13:11.014 INFO:teuthology.orchestra.run.smithi156.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 552 kB/s | 188 kB 00:00 2024-05-14T15:13:11.040 INFO:teuthology.orchestra.run.smithi156.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 187 kB/s | 36 kB 00:00 2024-05-14T15:13:11.098 INFO:teuthology.orchestra.run.smithi156.stdout:(141/156): python3-rsa-4.9-2.el9.noarch.rpm 215 kB/s | 59 kB 00:00 2024-05-14T15:13:11.157 INFO:teuthology.orchestra.run.smithi156.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 361 kB/s | 51 kB 00:00 2024-05-14T15:13:11.257 INFO:teuthology.orchestra.run.smithi156.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-05-14T15:13:11.264 INFO:teuthology.orchestra.run.smithi002.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-05-14T15:13:11.374 INFO:teuthology.orchestra.run.smithi156.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 327 kB/s | 90 kB 00:00 2024-05-14T15:13:11.399 INFO:teuthology.orchestra.run.smithi156.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 142 kB/s | 20 kB 00:00 2024-05-14T15:13:11.608 INFO:teuthology.orchestra.run.smithi156.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 951 kB/s | 427 kB 00:00 2024-05-14T15:13:11.633 INFO:teuthology.orchestra.run.smithi156.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 743 kB/s | 192 kB 00:00 2024-05-14T15:13:11.992 INFO:teuthology.orchestra.run.smithi156.stdout:(148/156): librados2-19.0.0-3588.ge2b755a6.el9. 8.7 MB/s | 3.3 MB 00:00 2024-05-14T15:13:12.050 INFO:teuthology.orchestra.run.smithi156.stdout:(149/156): thrift-0.15.0-2.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2024-05-14T15:13:12.217 INFO:teuthology.orchestra.run.smithi156.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-05-14T15:13:12.222 INFO:teuthology.orchestra.run.smithi002.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 324 kB/s | 309 kB 00:00 2024-05-14T15:13:12.276 INFO:teuthology.orchestra.run.smithi156.stdout:(151/156): NetworkManager-1.47.90-1.el9.x86_64. 8.2 MB/s | 2.3 MB 00:00 2024-05-14T15:13:12.326 INFO:teuthology.orchestra.run.smithi156.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 384 kB/s | 41 kB 00:00 2024-05-14T15:13:12.331 INFO:teuthology.orchestra.run.smithi002.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 181 kB/s | 19 kB 00:00 2024-05-14T15:13:12.381 INFO:teuthology.orchestra.run.smithi002.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 372 kB/s | 548 kB 00:01 2024-05-14T15:13:12.402 INFO:teuthology.orchestra.run.smithi156.stdout:(153/156): NetworkManager-tui-1.47.90-1.el9.x86 1.9 MB/s | 248 kB 00:00 2024-05-14T15:13:12.423 INFO:teuthology.orchestra.run.smithi002.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 482 kB/s | 863 kB 00:01 2024-05-14T15:13:12.507 INFO:teuthology.orchestra.run.smithi002.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-05-14T15:13:12.519 INFO:teuthology.orchestra.run.smithi156.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 7.1 MB/s | 1.3 MB 00:00 2024-05-14T15:13:12.627 INFO:teuthology.orchestra.run.smithi156.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-05-14T15:13:12.774 INFO:teuthology.orchestra.run.smithi002.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 351 kB/s | 67 kB 00:00 2024-05-14T15:13:13.041 INFO:teuthology.orchestra.run.smithi002.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 79 kB/s | 49 kB 00:00 2024-05-14T15:13:13.066 INFO:teuthology.orchestra.run.smithi002.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 519 kB/s | 151 kB 00:00 2024-05-14T15:13:13.077 INFO:teuthology.orchestra.run.smithi156.stdout:(156/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 2.1 MB/s | 3.1 MB 00:01 2024-05-14T15:13:13.084 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:13:13.084 INFO:teuthology.orchestra.run.smithi156.stdout:Total 8.6 MB/s | 219 MB 00:25 2024-05-14T15:13:13.875 INFO:teuthology.orchestra.run.smithi002.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 679 kB/s | 548 kB 00:00 2024-05-14T15:13:14.000 INFO:teuthology.orchestra.run.smithi002.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 350 kB/s | 43 kB 00:00 2024-05-14T15:13:14.127 INFO:teuthology.orchestra.run.smithi002.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 256 kB/s | 32 kB 00:00 2024-05-14T15:13:14.176 INFO:teuthology.orchestra.run.smithi002.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 740 kB/s | 839 kB 00:01 2024-05-14T15:13:14.234 INFO:teuthology.orchestra.run.smithi002.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 141 kB/s | 15 kB 00:00 2024-05-14T15:13:14.443 INFO:teuthology.orchestra.run.smithi002.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 645 kB/s | 172 kB 00:00 2024-05-14T15:13:14.751 INFO:teuthology.orchestra.run.smithi002.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 694 kB/s | 358 kB 00:00 2024-05-14T15:13:14.860 INFO:teuthology.orchestra.run.smithi002.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 327 kB/s | 35 kB 00:00 2024-05-14T15:13:14.894 INFO:teuthology.orchestra.run.smithi002.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 673 kB/s | 303 kB 00:00 2024-05-14T15:13:15.203 INFO:teuthology.orchestra.run.smithi002.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 602 kB/s | 206 kB 00:00 2024-05-14T15:13:15.478 INFO:teuthology.orchestra.run.smithi002.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 526 kB/s | 144 kB 00:00 2024-05-14T15:13:15.586 INFO:teuthology.orchestra.run.smithi002.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-05-14T15:13:15.703 INFO:teuthology.orchestra.run.smithi002.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-05-14T15:13:15.820 INFO:teuthology.orchestra.run.smithi002.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-05-14T15:13:15.929 INFO:teuthology.orchestra.run.smithi002.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-05-14T15:13:16.038 INFO:teuthology.orchestra.run.smithi002.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 183 kB/s | 20 kB 00:00 2024-05-14T15:13:16.132 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-05-14T15:13:16.380 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-05-14T15:13:16.380 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-05-14T15:13:17.371 INFO:teuthology.orchestra.run.smithi002.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 784 kB/s | 1.0 MB 00:01 2024-05-14T15:13:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 820 kB/s | 2.0 MB 00:02 2024-05-14T15:13:17.480 INFO:teuthology.orchestra.run.smithi002.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 430 kB/s | 46 kB 00:00 2024-05-14T15:13:17.622 INFO:teuthology.orchestra.run.smithi002.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 430 kB/s | 79 kB 00:00 2024-05-14T15:13:17.664 INFO:teuthology.orchestra.run.smithi002.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 315 kB/s | 58 kB 00:00 2024-05-14T15:13:17.819 INFO:teuthology.orchestra.run.smithi002.stdout:(133/156): libarrow-9.0.0-11.el9.x86_64.rpm 824 kB/s | 4.4 MB 00:05 2024-05-14T15:13:17.848 INFO:teuthology.orchestra.run.smithi002.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 90 kB/s | 16 kB 00:00 2024-05-14T15:13:17.957 INFO:teuthology.orchestra.run.smithi002.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 262 kB/s | 28 kB 00:00 2024-05-14T15:13:18.010 INFO:teuthology.orchestra.run.smithi002.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 482 kB/s | 90 kB 00:00 2024-05-14T15:13:18.065 INFO:teuthology.orchestra.run.smithi002.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-05-14T15:13:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 582 kB/s | 272 kB 00:00 2024-05-14T15:13:18.230 INFO:teuthology.orchestra.run.smithi002.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 258 kB/s | 36 kB 00:00 2024-05-14T15:13:18.258 INFO:teuthology.orchestra.run.smithi002.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 308 kB/s | 59 kB 00:00 2024-05-14T15:13:18.291 INFO:teuthology.orchestra.run.smithi002.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 664 kB/s | 188 kB 00:00 2024-05-14T15:13:18.333 INFO:teuthology.orchestra.run.smithi002.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 497 kB/s | 51 kB 00:00 2024-05-14T15:13:18.492 INFO:teuthology.orchestra.run.smithi002.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 449 kB/s | 90 kB 00:00 2024-05-14T15:13:18.600 INFO:teuthology.orchestra.run.smithi002.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-05-14T15:13:18.659 INFO:teuthology.orchestra.run.smithi002.stdout:(145/156): python3-webob-1.8.7-6.el9.noarch.rpm 574 kB/s | 230 kB 00:00 2024-05-14T15:13:18.868 INFO:teuthology.orchestra.run.smithi002.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 720 kB/s | 192 kB 00:00 2024-05-14T15:13:18.884 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-05-14T15:13:18.884 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-05-14T15:13:18.976 INFO:teuthology.orchestra.run.smithi002.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 665 kB/s | 427 kB 00:00 2024-05-14T15:13:19.369 INFO:teuthology.orchestra.run.smithi002.stdout:(148/156): librados2-19.0.0-3588.ge2b755a6.el9. 6.7 MB/s | 3.3 MB 00:00 2024-05-14T15:13:19.444 INFO:teuthology.orchestra.run.smithi002.stdout:(149/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-05-14T15:13:19.602 INFO:teuthology.orchestra.run.smithi002.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-05-14T15:13:19.661 INFO:teuthology.orchestra.run.smithi002.stdout:(151/156): NetworkManager-1.47.90-1.el9.x86_64. 7.9 MB/s | 2.3 MB 00:00 2024-05-14T15:13:19.703 INFO:teuthology.orchestra.run.smithi002.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 416 kB/s | 41 kB 00:00 2024-05-14T15:13:19.745 INFO:teuthology.orchestra.run.smithi002.stdout:(153/156): NetworkManager-tui-1.47.90-1.el9.x86 2.9 MB/s | 248 kB 00:00 2024-05-14T15:13:19.890 INFO:teuthology.orchestra.run.smithi002.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 7.3 MB/s | 1.3 MB 00:00 2024-05-14T15:13:19.987 INFO:teuthology.orchestra.run.smithi002.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-05-14T15:13:20.795 INFO:teuthology.orchestra.run.smithi002.stdout:(156/156): thrift-0.15.0-2.el9.x86_64.rpm 758 kB/s | 1.6 MB 00:02 2024-05-14T15:13:20.808 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:13:20.808 INFO:teuthology.orchestra.run.smithi002.stdout:Total 8.4 MB/s | 219 MB 00:26 2024-05-14T15:13:23.923 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-05-14T15:13:24.185 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-05-14T15:13:24.185 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-05-14T15:13:25.394 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-05-14T15:13:25.509 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T15:13:25.593 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T15:13:25.695 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T15:13:25.755 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T15:13:25.786 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T15:13:25.861 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T15:13:26.283 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T15:13:26.401 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:13:26.582 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:13:26.619 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:13:26.747 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:13:26.793 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:13:26.843 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-05-14T15:13:26.843 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-05-14T15:13:27.098 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T15:13:27.165 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T15:13:27.190 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:13:27.337 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:13:27.374 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:13:27.460 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:13:27.492 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:13:27.560 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:13:27.857 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:13:28.201 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:13:28.390 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:13:28.479 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:13:28.681 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:13:28.819 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:13:29.147 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:13:29.338 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T15:13:29.374 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T15:13:29.427 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T15:13:29.532 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T15:13:29.579 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T15:13:29.643 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T15:13:29.691 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T15:13:29.731 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T15:13:29.845 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T15:13:29.943 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T15:13:29.984 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T15:13:30.041 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T15:13:30.149 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T15:13:30.186 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T15:13:30.235 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T15:13:30.268 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T15:13:30.374 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T15:13:30.448 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T15:13:30.557 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T15:13:30.737 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T15:13:30.801 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T15:13:31.490 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T15:13:31.597 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T15:13:31.633 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T15:13:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T15:13:31.718 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T15:13:31.777 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T15:13:31.971 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T15:13:32.095 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T15:13:32.228 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T15:13:32.297 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T15:13:32.393 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T15:13:32.437 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T15:13:32.475 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T15:13:32.551 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T15:13:32.593 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T15:13:32.657 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T15:13:32.723 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T15:13:32.919 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T15:13:32.975 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T15:13:33.004 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T15:13:33.059 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T15:13:33.186 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T15:13:33.228 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T15:13:33.273 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T15:13:33.310 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T15:13:33.343 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T15:13:33.508 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-05-14T15:13:33.537 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T15:13:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T15:13:33.669 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T15:13:33.717 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T15:13:33.758 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T15:13:33.764 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T15:13:33.787 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T15:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T15:13:33.824 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T15:13:33.854 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T15:13:33.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T15:13:33.936 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T15:13:33.980 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T15:13:33.991 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T15:13:34.025 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T15:13:34.076 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T15:13:34.153 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T15:13:34.199 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T15:13:34.371 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T15:13:34.448 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T15:13:34.467 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T15:13:34.491 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T15:13:34.562 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T15:13:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:13:34.709 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T15:13:34.778 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T15:13:34.789 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:13:34.820 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:13:34.959 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:13:34.994 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:13:35.302 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T15:13:35.375 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T15:13:35.399 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:13:35.564 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:13:35.592 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:13:35.687 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:13:35.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:13:35.790 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:13:35.792 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T15:13:35.860 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T15:13:35.894 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T15:13:36.010 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T15:13:36.071 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T15:13:36.127 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:13:36.167 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T15:13:36.220 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T15:13:36.448 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T15:13:36.483 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T15:13:36.488 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:13:36.585 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T15:13:36.683 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:13:36.772 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:13:36.932 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:13:37.019 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:13:37.361 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:13:37.430 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T15:13:37.510 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T15:13:37.549 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T15:13:37.597 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T15:13:37.598 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T15:13:37.713 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T15:13:37.763 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T15:13:37.828 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T15:13:37.876 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T15:13:37.915 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T15:13:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T15:13:38.122 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T15:13:38.159 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T15:13:38.215 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T15:13:38.327 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T15:13:38.370 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T15:13:38.420 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T15:13:38.460 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T15:13:38.582 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T15:13:38.640 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T15:13:38.768 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T15:13:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T15:13:39.017 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T15:13:39.237 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T15:13:39.340 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T15:13:39.376 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T15:13:39.409 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T15:13:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T15:13:39.779 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T15:13:39.827 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:13:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T15:13:39.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T15:13:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T15:13:39.977 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T15:13:39.981 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:13:40.016 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T15:13:40.039 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T15:13:40.074 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T15:13:40.275 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T15:13:40.336 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T15:13:40.462 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T15:13:40.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T15:13:40.628 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T15:13:40.634 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T15:13:40.663 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:13:40.677 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T15:13:40.716 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T15:13:40.754 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:13:40.782 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T15:13:40.798 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T15:13:40.825 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T15:13:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T15:13:40.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T15:13:41.195 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T15:13:41.248 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T15:13:41.311 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T15:13:41.370 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T15:13:41.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T15:13:41.561 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T15:13:41.613 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T15:13:41.650 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T15:13:41.715 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T15:13:41.930 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T15:13:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T15:13:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T15:13:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T15:13:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T15:13:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T15:13:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T15:13:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T15:13:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T15:13:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T15:13:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T15:13:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T15:13:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T15:13:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T15:13:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T15:13:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T15:13:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T15:13:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T15:13:43.385 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:13:43.420 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:13:44.071 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:13:44.123 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:13:44.274 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T15:13:44.332 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T15:13:44.336 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:13:44.336 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T15:13:44.336 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T15:13:44.337 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:13:44.366 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T15:13:44.374 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:13:44.491 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T15:13:44.552 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T15:13:44.679 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T15:13:44.725 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T15:13:44.971 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T15:13:45.005 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T15:13:45.121 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T15:13:45.997 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T15:13:46.148 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T15:13:47.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T15:13:47.988 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T15:13:48.022 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T15:13:48.067 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T15:13:48.474 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T15:13:48.516 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:13:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:13:48.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T15:13:48.748 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T15:13:49.353 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T15:13:49.386 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:13:49.513 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:13:49.538 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T15:13:52.295 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:13:52.368 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:13:53.104 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:13:53.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:13:53.318 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:13:53.318 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T15:13:53.318 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T15:13:53.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:13:53.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:13:57.247 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:13:57.247 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2024-05-14T15:13:57.247 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2024-05-14T15:13:57.247 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2024-05-14T15:13:57.247 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2024-05-14T15:13:57.247 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2024-05-14T15:13:57.248 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /root 2024-05-14T15:13:57.248 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2024-05-14T15:13:57.248 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:13:57.505 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:13:57.555 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:13:57.555 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:13:57.556 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T15:13:57.556 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:13:59.275 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:13:59.354 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:13:59.354 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:13:59.354 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T15:13:59.354 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:13:59.355 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:13:59.355 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:13:59.608 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:13:59.684 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:13:59.684 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:13:59.684 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T15:13:59.684 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:13:59.684 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:13:59.684 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:00.225 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:14:00.301 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:14:00.301 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:00.301 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T15:14:00.301 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:14:00.301 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:14:00.301 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:00.433 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T15:14:00.496 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T15:14:00.570 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T15:14:00.804 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T15:14:00.863 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T15:14:00.972 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T15:14:01.073 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T15:14:01.239 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T15:14:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T15:14:01.327 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T15:14:01.369 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T15:14:01.899 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:14:01.938 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:14:02.009 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T15:14:02.120 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T15:14:02.158 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:14:03.446 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:14:03.484 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:14:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:14:04.617 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:14:04.774 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:14:04.954 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T15:14:04.986 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:14:05.078 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:14:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T15:14:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:14:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:14:05.079 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:05.273 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:14:05.313 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:14:05.480 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T15:14:05.562 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T15:14:06.578 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T15:14:06.615 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:14:06.677 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:14:06.677 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:06.677 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T15:14:06.678 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:14:06.678 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:14:06.678 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:06.732 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:14:06.800 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:14:06.801 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:06.801 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T15:14:06.801 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:06.874 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:14:06.949 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:14:06.949 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:06.949 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T15:14:06.949 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:14:06.949 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:14:06.950 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:07.333 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:14:07.392 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:14:07.392 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-05-14T15:14:07.392 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-05-14T15:14:07.392 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-05-14T15:14:07.393 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-05-14T15:14:07.393 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-05-14T15:14:07.393 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-05-14T15:14:07.393 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-05-14T15:14:07.393 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:14:07.407 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:07.407 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T15:14:07.407 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:14:07.407 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:14:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:07.628 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:14:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:14:07.677 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:07.677 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T15:14:07.677 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:09.464 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:14:09.547 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:14:09.548 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:09.548 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T15:14:09.548 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:14:09.548 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:14:09.548 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:09.822 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:14:09.909 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:14:09.910 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:09.910 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T15:14:09.910 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:14:09.910 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:14:09.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:10.456 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:14:10.529 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:14:10.529 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:10.529 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T15:14:10.529 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:14:10.529 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:14:10.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:10.683 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T15:14:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T15:14:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T15:14:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T15:14:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T15:14:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T15:14:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T15:14:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T15:14:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T15:14:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T15:14:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T15:14:12.106 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T15:14:12.175 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T15:14:12.234 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T15:14:12.280 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T15:14:12.322 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T15:14:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:14:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:14:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T15:14:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T15:14:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:14:12.626 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T15:14:12.679 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T15:14:12.708 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T15:14:12.752 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T15:14:12.818 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T15:14:13.656 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:14:13.698 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:14:13.757 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:14:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:14:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:14:15.114 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T15:14:15.151 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:14:15.181 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:14:15.222 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T15:14:15.286 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T15:14:15.347 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:14:15.429 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T15:14:15.465 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T15:14:15.502 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T15:14:15.502 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:14:15.534 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T15:14:15.567 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:14:15.623 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:14:15.638 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:14:15.638 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:15.638 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T15:14:15.638 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:14:15.638 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:14:15.638 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:15.670 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T15:14:15.670 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:14:15.693 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:14:15.731 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:14:15.815 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:14:15.848 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T15:14:15.854 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T15:14:15.889 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:14:15.889 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:14:15.950 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T15:14:16.234 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:14:16.235 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:14:16.362 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:14:16.493 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:14:16.762 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:14:16.762 INFO:teuthology.orchestra.run.smithi156.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T15:14:16.762 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:17.028 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T15:14:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:14:17.136 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:14:17.136 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:17.136 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T15:14:17.136 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:14:17.136 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:14:17.136 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:17.187 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:14:17.259 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:14:17.259 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:17.260 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T15:14:17.260 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:17.330 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:14:17.408 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:14:17.408 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:17.409 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T15:14:17.409 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:14:17.409 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:14:17.409 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:17.805 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:14:17.882 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:14:17.882 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:14:17.882 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T15:14:17.882 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:14:17.883 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:14:17.883 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:14:22.729 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T15:14:22.730 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T15:14:22.731 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T15:14:22.731 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T15:14:22.731 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T15:14:22.731 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T15:14:22.743 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T15:14:22.743 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T15:14:22.744 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T15:14:22.745 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T15:14:22.746 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T15:14:22.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T15:14:22.748 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T15:14:22.749 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T15:14:22.750 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T15:14:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T15:14:22.752 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T15:14:22.753 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T15:14:22.837 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T15:14:22.910 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T15:14:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T15:14:23.011 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T15:14:23.049 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T15:14:23.354 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T15:14:23.426 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T15:14:23.456 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T15:14:23.502 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T15:14:23.549 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T15:14:24.452 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:14:24.516 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:14:24.577 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:24.885 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.886 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.887 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T15:14:24.888 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T15:14:24.890 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T15:14:24.891 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T15:14:24.892 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T15:14:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T15:14:24.894 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T15:14:24.895 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T15:14:24.896 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T15:14:24.897 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:24.897 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-05-14T15:14:25.507 DEBUG:teuthology.parallel:result is None 2024-05-14T15:14:26.023 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T15:14:26.127 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T15:14:26.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T15:14:26.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T15:14:26.420 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T15:14:26.457 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T15:14:26.457 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:14:26.619 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:14:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T15:14:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:14:26.811 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:14:26.850 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T15:14:26.885 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:14:26.886 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:14:27.246 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:14:27.246 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:14:27.401 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:14:27.545 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:14:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:14:27.826 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T15:14:27.826 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:33.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T15:14:33.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T15:14:33.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T15:14:33.604 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T15:14:33.605 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T15:14:33.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T15:14:33.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T15:14:33.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T15:14:33.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T15:14:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T15:14:33.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T15:14:33.621 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T15:14:33.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T15:14:33.623 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T15:14:33.624 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T15:14:33.625 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T15:14:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T15:14:33.627 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T15:14:33.628 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T15:14:35.921 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:14:35.921 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:35.921 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T15:14:35.922 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T15:14:35.924 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T15:14:35.925 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T15:14:35.926 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T15:14:35.927 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T15:14:35.928 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T15:14:35.929 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T15:14:35.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T15:14:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T15:14:35.932 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T15:14:35.933 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T15:14:35.933 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T15:14:35.933 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T15:14:35.933 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T15:14:35.933 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:35.933 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-05-14T15:14:36.564 DEBUG:teuthology.parallel:result is None 2024-05-14T15:14:36.565 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:14:36.791 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T15:14:36.849 INFO:teuthology.orchestra.run.smithi002.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T15:14:36.850 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T15:14:36.850 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T15:14:36.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:14:37.070 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T15:14:37.143 INFO:teuthology.orchestra.run.smithi156.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T15:14:37.143 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T15:14:37.143 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T15:14:37.145 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T15:14:37.145 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:37.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T15:14:37.225 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:37.225 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T15:14:37.320 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T15:14:37.321 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:37.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T15:14:37.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T15:14:37.504 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:37.504 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T15:14:37.585 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T15:14:37.668 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T15:14:37.668 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:37.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T15:14:37.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T15:14:37.843 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:37.844 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T15:14:37.932 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T15:14:38.061 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T15:14:38.061 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:38.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T15:14:38.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T15:14:38.240 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:38.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T15:14:38.329 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T15:14:38.410 INFO:teuthology.run_tasks:Running task ceph... 2024-05-14T15:14:38.502 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-14T15:14:38.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-05-14T15:14:38.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2024-05-14T15:14:38.593 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-14T15:14:38.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T15:14:38.598 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T15:14:38.684 INFO:tasks.ceph:Creating extra log directories... 2024-05-14T15:14:38.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T15:14:38.689 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T15:14:38.782 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-14T15:14:38.783 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-14T15:14:38.783 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-14T15:14:38.783 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:38.783 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T15:14:38.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:39.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:39.112 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:39.112 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T15:14:39.169 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:39.384 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:39.476 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-14T15:14:39.476 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-14T15:14:39.476 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883', 'branch': 'wip-vshankar-testing-20240509.053109-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7705883', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240509.053109-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240509.053109-debug', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6285, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'sleep_before_teardown': 0, 'subset': '548/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240509.053109-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJDctHgxwxwdmTHmBMSuDYiAAHjOFRysYfTeXT88sKgqy1bX5giYi4SFsduoFT5no2/y3ZbUrKY3Zxl6V9tuoHk=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5vZrVO7H7YxUnZ537Mogs9gMThAxjOPrnTcNUpN6OpwsCfy8kYIFO1uRdyTD6lftYqIX6Exc1Ke+NKu2ixNzc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-14_07:04:04', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-14T15:14:39.477 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T15:14:39.482 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T15:14:39.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T15:14:39.567 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T15:14:39.651 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:39.651 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T15:14:39.693 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T15:14:39.693 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-05-14T15:14:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T15:14:39.773 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-05-14 15:14:28.286235505 +0000 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-05-14 15:11:30.420217672 +0000 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-05-14 15:11:30.420217672 +0000 2024-05-14T15:14:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-05-14 15:11:30.420217672 +0000 2024-05-14T15:14:39.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T15:14:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-05-14T15:14:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-05-14T15:14:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000240771 s, 2.1 MB/s 2024-05-14T15:14:39.880 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T15:14:39.922 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-05-14T15:14:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T15:14:40.002 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-14T15:14:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-05-14 15:14:28.287235481 +0000 2024-05-14T15:14:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-05-14 15:11:31.013203456 +0000 2024-05-14T15:14:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-05-14 15:11:31.013203456 +0000 2024-05-14T15:14:40.003 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-05-14 15:11:31.013203456 +0000 2024-05-14T15:14:40.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T15:14:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-05-14T15:14:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-05-14T15:14:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000180052 s, 2.8 MB/s 2024-05-14T15:14:40.112 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T15:14:40.153 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-05-14 15:14:28.288235458 +0000 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-05-14 15:11:31.636188520 +0000 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-05-14 15:11:31.636188520 +0000 2024-05-14T15:14:40.239 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-05-14 15:11:31.636188520 +0000 2024-05-14T15:14:40.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T15:14:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-05-14T15:14:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-05-14T15:14:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000214814 s, 2.4 MB/s 2024-05-14T15:14:40.346 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T15:14:40.390 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-05-14T15:14:40.471 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T15:14:40.471 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-14T15:14:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-05-14 15:14:28.289235435 +0000 2024-05-14T15:14:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-05-14 15:11:32.251173776 +0000 2024-05-14T15:14:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-05-14 15:11:32.251173776 +0000 2024-05-14T15:14:40.472 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-05-14 15:11:32.251173776 +0000 2024-05-14T15:14:40.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T15:14:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-05-14T15:14:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-05-14T15:14:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000278311 s, 1.8 MB/s 2024-05-14T15:14:40.602 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T15:14:40.660 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T15:14:40.660 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:40.660 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T15:14:40.717 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T15:14:40.718 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2024-05-14T15:14:40.770 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-05-14 15:14:17.203305007 +0000 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-05-14 15:11:26.560509348 +0000 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-05-14 15:11:26.560509348 +0000 2024-05-14T15:14:40.771 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-05-14 15:11:26.560509348 +0000 2024-05-14T15:14:40.771 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T15:14:40.849 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-05-14T15:14:40.849 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-05-14T15:14:40.850 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000254677 s, 2.0 MB/s 2024-05-14T15:14:40.853 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T15:14:40.909 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2024-05-14T15:14:40.959 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T15:14:40.959 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:40.959 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-14T15:14:40.960 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:40.960 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:40.960 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-05-14 15:14:17.204304993 +0000 2024-05-14T15:14:40.960 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-05-14 15:11:27.147500320 +0000 2024-05-14T15:14:40.960 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-05-14 15:11:27.147500320 +0000 2024-05-14T15:14:40.960 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-05-14 15:11:27.147500320 +0000 2024-05-14T15:14:40.960 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T15:14:41.037 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-05-14T15:14:41.037 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-05-14T15:14:41.037 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000250076 s, 2.0 MB/s 2024-05-14T15:14:41.041 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T15:14:41.099 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2024-05-14T15:14:41.148 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-05-14 15:14:17.205304978 +0000 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-05-14 15:11:27.727491399 +0000 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-05-14 15:11:27.727491399 +0000 2024-05-14T15:14:41.149 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-05-14 15:11:27.727491399 +0000 2024-05-14T15:14:41.149 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T15:14:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-05-14T15:14:41.228 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-05-14T15:14:41.228 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00024547 s, 2.1 MB/s 2024-05-14T15:14:41.231 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T15:14:41.287 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-05-14 15:14:17.206304964 +0000 2024-05-14T15:14:41.338 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-05-14 15:11:28.304482525 +0000 2024-05-14T15:14:41.339 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-05-14 15:11:28.304482525 +0000 2024-05-14T15:14:41.339 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-05-14 15:11:28.304482525 +0000 2024-05-14T15:14:41.339 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T15:14:41.420 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-05-14T15:14:41.420 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-05-14T15:14:41.420 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000264168 s, 1.9 MB/s 2024-05-14T15:14:41.424 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T15:14:41.480 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T15:14:41.480 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T15:14:41.480 INFO:tasks.ceph:Generating config... 2024-05-14T15:14:41.481 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-14T15:14:41.481 INFO:tasks.ceph:[client] debug client = 20 2024-05-14T15:14:41.481 INFO:tasks.ceph:[client] debug ms = 1 2024-05-14T15:14:41.481 INFO:tasks.ceph:[client] pid file = 2024-05-14T15:14:41.481 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-14T15:14:41.482 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-14T15:14:41.482 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-14T15:14:41.483 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-14T15:14:41.483 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-14T15:14:41.483 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-14T15:14:41.483 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-14T15:14:41.483 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-14T15:14:41.483 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-14T15:14:41.484 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-14T15:14:41.484 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-14T15:14:41.484 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-14T15:14:41.484 INFO:tasks.ceph:Setting up mon.a... 2024-05-14T15:14:41.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-14T15:14:41.706 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-05-14T15:14:41.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-14T15:14:41.931 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T15:14:42.015 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.156'), ('mon.c', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]')] 2024-05-14T15:14:42.015 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-14T15:14:42.016 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:42.016 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T15:14:42.071 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.156 --addv c '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid c9147305-965e-4a8b-a03b-3f802813a40c 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:fsid c9147305-965e-4a8b-a03b-3f802813a40c 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-05-14T15:14:42.309094+0000 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-05-14T15:14:42.309094+0000 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 17 (quincy) 2024-05-14T15:14:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-05-14T15:14:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-05-14T15:14:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-05-14T15:14:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.c 2024-05-14T15:14:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-14T15:14:42.316 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T15:14:42.369 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c9147305-965e-4a8b-a03b-3f802813a40c... 2024-05-14T15:14:42.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T15:14:42.377 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T15:14:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-05-14T15:14:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-05-14T15:14:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T15:14:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = c9147305-965e-4a8b-a03b-3f802813a40c 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-05-14T15:14:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-05-14T15:14:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 20 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 20 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-05-14T15:14:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 10 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-05-14T15:14:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T15:14:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T15:14:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T15:14:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-05-14T15:14:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-05-14T15:14:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: mon down mkfs grace = 300 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2024-05-14T15:14:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2024-05-14T15:14:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-05-14T15:14:42.529 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2024-05-14T15:14:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2024-05-14T15:14:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2024-05-14T15:14:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.2,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = c9147305-965e-4a8b-a03b-3f802813a40c 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2024-05-14T15:14:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug trim objects = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2024-05-14T15:14:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 20 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 20 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 10 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2024-05-14T15:14:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.536 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T15:14:42.537 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: mon down mkfs grace = 300 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: mon op complaint time = 120 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2024-05-14T15:14:42.538 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: client mount timeout = 600 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = "" 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2024-05-14T15:14:42.539 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds = 20 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds balancer = 20 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug frag = True 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug scatterstat = True 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: mds op complaint time = 180 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: mds verify scatter = True 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2024-05-14T15:14:42.540 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2024-05-14T15:14:42.557 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-14T15:14:42.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-14T15:14:42.777 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-14T15:14:42.777 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:42.777 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-14T15:14:42.831 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:42.831 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-14T15:14:42.887 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:14:42.887 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:42.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T15:14:42.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T15:14:43.004 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:14:43.004 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:43.103 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:14:43.103 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:43.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T15:14:43.104 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T15:14:43.227 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:14:43.227 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:43.323 INFO:tasks.ceph:Setting up mon nodes... 2024-05-14T15:14:43.323 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-14T15:14:43.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T15:14:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T15:14:43.588 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T15:14:43.845 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T15:14:43.864 INFO:tasks.ceph:Setting up mds nodes... 2024-05-14T15:14:43.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T15:14:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T15:14:44.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-14T15:14:44.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T15:14:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T15:14:44.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-14T15:14:44.576 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T15:14:44.811 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T15:14:44.828 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-14T15:14:44.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T15:14:45.124 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T15:14:45.140 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-14T15:14:45.225 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-14T15:14:45.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T15:14:45.421 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-14T15:14:45.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-14T15:14:45.677 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-14T15:14:45.740 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-14T15:14:45.926 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-14T15:14:45.973 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-14T15:14:46.155 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-14T15:14:46.211 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-14T15:14:46.211 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T15:14:46.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-14T15:14:46.307 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T15:14:46.307 INFO:tasks.ceph:role: osd.0 2024-05-14T15:14:46.307 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:14:46.307 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T15:14:46.397 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:14:46.397 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:14:46.397 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:14:46.398 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:14:46.431 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-05-14T15:14:46.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-05-14T15:14:46.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-14T15:14:46.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-14T15:14:46.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-14T15:14:46.678 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T15:14:46.678 INFO:tasks.ceph:role: osd.1 2024-05-14T15:14:46.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:14:46.679 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T15:14:46.753 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:14:46.753 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:14:46.753 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:14:46.753 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:14:46.753 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:14:46.754 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:14:46.754 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:14:46.754 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:14:46.754 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:14:46.754 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:14:46.787 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-05-14T15:14:46.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-05-14T15:14:46.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-14T15:14:46.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-14T15:14:46.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-14T15:14:47.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T15:14:47.022 INFO:tasks.ceph:role: osd.2 2024-05-14T15:14:47.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:14:47.022 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T15:14:47.085 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:14:47.086 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:14:47.118 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-05-14T15:14:47.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-05-14T15:14:47.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-14T15:14:47.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-14T15:14:47.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-14T15:14:47.345 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T15:14:47.345 INFO:tasks.ceph:role: osd.3 2024-05-14T15:14:47.345 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:14:47.345 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T15:14:47.415 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:14:47.415 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:14:47.415 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:14:47.415 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:14:47.415 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:14:47.415 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:14:47.416 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:14:47.416 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:14:47.416 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:14:47.416 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:14:47.449 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-05-14T15:14:47.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-05-14T15:14:47.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-14T15:14:47.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-14T15:14:47.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:47.820+0000 7f36c643d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-14T15:14:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:47.821+0000 7f36c643d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-14T15:14:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:47.821+0000 7f36c643d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T15:14:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:47.821+0000 7f36c643d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T15:14:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:47.821+0000 7f36c643d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T15:14:47.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:47.824+0000 7f36c643d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-14T15:14:51.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-14T15:14:51.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:51.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:51.344+0000 7feb1e263640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-14T15:14:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:51.345+0000 7feb1e263640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-14T15:14:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:51.345+0000 7feb1e263640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T15:14:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:51.345+0000 7feb1e263640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T15:14:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:51.345+0000 7feb1e263640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T15:14:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:51.347+0000 7feb1e263640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-14T15:14:54.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-14T15:14:54.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:54.879+0000 7f959320c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-14T15:14:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:54.880+0000 7f959320c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-14T15:14:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:54.880+0000 7f959320c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T15:14:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:54.880+0000 7f959320c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T15:14:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:54.880+0000 7f959320c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T15:14:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:54.882+0000 7f959320c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-14T15:14:58.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-14T15:14:58.196 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:14:58.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:58.391+0000 7ff34cc86640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-14T15:14:58.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:58.391+0000 7ff34cc86640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-14T15:14:58.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:58.391+0000 7ff34cc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T15:14:58.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:58.391+0000 7ff34cc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T15:14:58.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:58.391+0000 7ff34cc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T15:14:58.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:14:58.394+0000 7ff34cc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-14T15:15:01.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-14T15:15:01.699 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-14T15:15:01.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T15:15:01.792 INFO:tasks.ceph:role: osd.4 2024-05-14T15:15:01.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:15:01.792 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T15:15:01.875 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:15:01.875 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:15:01.876 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:15:01.910 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-05-14T15:15:01.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-05-14T15:15:01.915 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-14T15:15:02.023 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-14T15:15:02.093 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-14T15:15:02.158 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T15:15:02.158 INFO:tasks.ceph:role: osd.5 2024-05-14T15:15:02.158 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:15:02.158 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T15:15:02.224 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:15:02.224 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:15:02.225 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:15:02.257 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-05-14T15:15:02.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-05-14T15:15:02.262 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-14T15:15:02.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-14T15:15:02.424 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-14T15:15:02.485 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T15:15:02.485 INFO:tasks.ceph:role: osd.6 2024-05-14T15:15:02.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:15:02.485 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T15:15:02.550 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:15:02.551 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:15:02.584 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-05-14T15:15:02.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-05-14T15:15:02.588 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-14T15:15:02.678 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-14T15:15:02.746 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-14T15:15:02.810 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T15:15:02.810 INFO:tasks.ceph:role: osd.7 2024-05-14T15:15:02.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:15:02.810 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T15:15:02.876 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T15:15:02.877 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T15:15:02.910 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-05-14T15:15:02.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-05-14T15:15:02.917 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-14T15:15:03.015 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-14T15:15:03.080 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:15:03.275 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:03.277+0000 7fd54be16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-14T15:15:03.276 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:03.277+0000 7fd54be16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-14T15:15:03.276 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:03.278+0000 7fd54be16640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T15:15:03.276 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:03.278+0000 7fd54be16640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T15:15:03.276 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:03.278+0000 7fd54be16640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T15:15:03.278 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:03.280+0000 7fd54be16640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-14T15:15:06.246 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-14T15:15:06.331 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:15:06.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:06.534+0000 7fa083e15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-14T15:15:06.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:06.534+0000 7fa083e15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-14T15:15:06.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:06.534+0000 7fa083e15640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T15:15:06.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:06.534+0000 7fa083e15640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T15:15:06.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:06.534+0000 7fa083e15640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T15:15:06.534 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:06.536+0000 7fa083e15640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-14T15:15:09.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:09.486 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:09.515 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-14T15:15:09.632 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:15:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:09.879+0000 7f5a4e6f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-14T15:15:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:09.880+0000 7f5a4e6f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-14T15:15:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:09.880+0000 7f5a4e6f0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T15:15:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:09.880+0000 7f5a4e6f0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T15:15:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:09.880+0000 7f5a4e6f0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T15:15:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:09.882+0000 7f5a4e6f0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-14T15:15:13.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-14T15:15:13.178 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:15:13.377 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:13.378+0000 7fb6283c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-14T15:15:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:13.379+0000 7fb6283c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-14T15:15:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:13.379+0000 7fb6283c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T15:15:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:13.379+0000 7fb6283c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T15:15:13.378 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:13.379+0000 7fb6283c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T15:15:13.380 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:13.381+0000 7fb6283c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-14T15:15:16.357 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-14T15:15:16.441 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-14T15:15:16.441 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:16.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-14T15:15:16.537 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:16.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-14T15:15:16.628 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:16.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-14T15:15:16.718 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:16.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-14T15:15:16.799 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:16.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-14T15:15:16.878 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:16.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-14T15:15:17.009 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:17.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-14T15:15:17.100 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.101 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-14T15:15:17.192 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.193 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-14T15:15:17.274 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-14T15:15:17.356 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.357 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-14T15:15:17.437 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.437 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-14T15:15:17.569 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.569 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-14T15:15:17.653 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.653 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-14T15:15:17.737 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:17.738 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-14T15:15:17.796 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:17.796 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-14T15:15:17.849 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.850 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-14T15:15:17.906 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:17.906 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-14T15:15:17.959 INFO:tasks.ceph:Adding keys to all mons... 2024-05-14T15:15:17.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T15:15:17.967 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDjf0NmfDZBIhAAa566CCFYYbV/06hDcLW6hQ== 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDkf0NmwsIGBxAACSRDI/TCHGBTUp7BU0Auqg== 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDkf0NmTFwOHBAAveqJ5HneY8OU1abFzPgzkA== 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDnf0NmwOv4MBAADORgfjI361wlZ2cmhd3P0Q== 2024-05-14T15:15:18.047 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDrf0Nm9UqcFBAAdi01CxUgzIG8EEhCGwkR6w== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDuf0NmDhx0NBAA3O/zS6AYEgmEtRfUIbGHkw== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDyf0NmgR1eFxAAufolFP+dt5Iupdo/yBAEkw== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDjf0Nm+weTMhAAla83rkqxMJPCvvsKLep/Jw== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDkf0NmMvqLMBAAb9uVsfX9n0vehJo5rK7aUQ== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDlf0NmlLSbBxAAiA3prVybb/j0H+SyIkx3bw== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQD3f0NmmUCaEBAA78MK+Fzhx04IZRGlngxodA== 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2024-05-14T15:15:18.048 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQD6f0NmM/DrHxAAZEpFcpm1YsxwGPT9YapkVg== 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQD9f0Nmk46FNBAA3eORaBBE+EumAV7jRhsZIA== 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQABgENm3CWtFhAAGTvxsI7lbhkSKHYgQrvTKg== 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDlf0NmBstLGRAAlDPeAYruInsfHUZyxMEQcw== 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout:[client.2] 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDlf0NmSq6XKBAAQjuH3s0WePNYbsSZv0SJeA== 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDlf0NmzuBtNxAAO9fEl7wrxDNDvikPqtgbcw== 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout:[client.3] 2024-05-14T15:15:18.049 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDmf0NmW815CRAAlY6vJVNgyzFR44pOq2n85Q== 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDjf0NmfDZBIhAAa566CCFYYbV/06hDcLW6hQ== 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDkf0NmwsIGBxAACSRDI/TCHGBTUp7BU0Auqg== 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDkf0NmTFwOHBAAveqJ5HneY8OU1abFzPgzkA== 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDnf0NmwOv4MBAADORgfjI361wlZ2cmhd3P0Q== 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-05-14T15:15:18.050 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDrf0Nm9UqcFBAAdi01CxUgzIG8EEhCGwkR6w== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDuf0NmDhx0NBAA3O/zS6AYEgmEtRfUIbGHkw== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDyf0NmgR1eFxAAufolFP+dt5Iupdo/yBAEkw== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDjf0Nm+weTMhAAla83rkqxMJPCvvsKLep/Jw== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDkf0NmMvqLMBAAb9uVsfX9n0vehJo5rK7aUQ== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDlf0NmlLSbBxAAiA3prVybb/j0H+SyIkx3bw== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD3f0NmmUCaEBAA78MK+Fzhx04IZRGlngxodA== 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2024-05-14T15:15:18.051 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD6f0NmM/DrHxAAZEpFcpm1YsxwGPT9YapkVg== 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD9f0Nmk46FNBAA3eORaBBE+EumAV7jRhsZIA== 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQABgENm3CWtFhAAGTvxsI7lbhkSKHYgQrvTKg== 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDlf0NmBstLGRAAlDPeAYruInsfHUZyxMEQcw== 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDlf0NmSq6XKBAAQjuH3s0WePNYbsSZv0SJeA== 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDlf0NmzuBtNxAAO9fEl7wrxDNDvikPqtgbcw== 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2024-05-14T15:15:18.052 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDmf0NmW815CRAAlY6vJVNgyzFR44pOq2n85Q== 2024-05-14T15:15:18.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T15:15:18.100 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T15:15:18.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:18.319 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:18.530 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:18.537 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:18.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:18.758 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:18.972 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:18.980 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:19.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:19.195 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:19.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:19.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:19.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T15:15:19.618 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T15:15:19.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:19.835 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:20.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:20.051 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T15:15:20.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.273 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.491 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.712 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.928 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:20.935 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T15:15:21.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.152 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.374 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.598 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:21.816 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T15:15:22.030 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-14T15:15:22.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-14T15:15:22.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T15:15:22.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-14T15:15:22.427 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-14T15:15:22.518 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T15:15:22.742 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-14T15:15:22.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-14T15:15:22.908 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T15:15:23.125 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-14T15:15:23.205 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:15:23.212 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T15:15:23.265 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-14T15:15:23.266 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-14T15:15:23.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-14T15:15:23.273 INFO:tasks.ceph.mon.a:Started 2024-05-14T15:15:23.273 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-14T15:15:23.273 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-14T15:15:23.278 INFO:tasks.ceph.mon.b:Started 2024-05-14T15:15:23.278 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-14T15:15:23.278 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-14T15:15:23.283 INFO:tasks.ceph.mon.c:Started 2024-05-14T15:15:23.283 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-14T15:15:23.283 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-14T15:15:23.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-14T15:15:23.292 INFO:tasks.ceph.mgr.y:Started 2024-05-14T15:15:23.292 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-14T15:15:23.292 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-14T15:15:23.297 INFO:tasks.ceph.mgr.x:Started 2024-05-14T15:15:23.298 INFO:tasks.ceph:Setting crush tunables to default 2024-05-14T15:15:23.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-05-14T15:15:23.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.545+0000 7fc1df000640 1 Processor -- start 2024-05-14T15:15:23.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.546+0000 7fc1df000640 1 -- start start 2024-05-14T15:15:23.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1df000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 0x7fc1d80b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1df000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1d80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1df000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d80cf080 con 0x7fc1d80b3e40 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1df000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc1d80b2340 con 0x7fc1d80ce320 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1df000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d80ce7e0 con 0x7fc1d80cff70 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1d80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1d80b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33054/0 (socket says 172.21.15.2:33054) 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 -- 172.21.15.2:0/3660296237 learned_addr learned my addr 172.21.15.2:0/3660296237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 0x7fc1d80b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 -- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 msgr2=0x7fc1d80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 -- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 msgr2=0x7fc1d80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1d80b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1d80b42d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1d7e00640 1 -- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 msgr2=0x7fc1d80b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.548+0000 7fc1d7e00640 1 -- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 msgr2=0x7fc1d80b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.549+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 0x7fc1d80b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T15:15:23.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.549+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 0x7fc1d80b3900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:15:23.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.565+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831206968 0 0) 0x7fc1d80cf080 con 0x7fc1d80b3e40 2024-05-14T15:15:23.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.565+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1bc003520 con 0x7fc1d80b3e40 2024-05-14T15:15:23.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1412228081 0 0) 0x7fc1bc003520 con 0x7fc1d80b3e40 2024-05-14T15:15:23.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 msgr2=0x7fc1d80b42d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:15:23.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1d80b42d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 msgr2=0x7fc1d80b3900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:15:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 --2- 172.21.15.2:0/3660296237 >> v2:172.21.15.2:3300/0 conn(0x7fc1d80ce320 0x7fc1d80b3900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d80ceac0 con 0x7fc1d80b3e40 2024-05-14T15:15:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fc1d0001a70 con 0x7fc1d80b3e40 2024-05-14T15:15:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 >> v1:172.21.15.156:6789/0 conn(0x7fc1d80b3e40 legacy=0x7fc1d80d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1bc003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1bc0040d0 0x7fc1bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc004d40 0x7fc1bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80b2340 con 0x7fc1bc004d40 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80ce7e0 con 0x7fc1bc0040d0 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.566+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc1bc00bcf0 con 0x7fc1d80cff70 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.567+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1bc0040d0 0x7fc1bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.567+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1bc003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.567+0000 7fc1cfe00640 1 -- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 msgr2=0x7fc1bc003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:23.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.567+0000 7fc1dd000640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc004d40 0x7fc1bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.567+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1bc003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.567+0000 7fc1cfe00640 1 -- 172.21.15.2:0/3660296237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc004d40 msgr2=0x7fc1bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.568+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc004d40 0x7fc1bc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.568+0000 7fc1cfe00640 1 -- 172.21.15.2:0/3660296237 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc003520 con 0x7fc1bc0040d0 2024-05-14T15:15:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.568+0000 7fc1dd000640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc004d40 0x7fc1bc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:23.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.568+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80cff70 0x7fc1bc003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.569+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1bc0040d0 0x7fc1bc004800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009890 tx=0x7fc1bc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e32db2fc11a133 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.569+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0037070 con 0x7fc1bc0040d0 2024-05-14T15:15:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.569+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c002ace0 con 0x7fc1bc0040d0 2024-05-14T15:15:23.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.569+0000 7fc1d7400640 1 -- 172.21.15.2:0/3660296237 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000f040 con 0x7fc1bc0040d0 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.570+0000 7fc1df000640 1 -- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1bc0040d0 msgr2=0x7fc1bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.571+0000 7fc1df000640 1 --2- 172.21.15.2:0/3660296237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1bc0040d0 0x7fc1bc004800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009890 tx=0x7fc1bc005830 comp rx=0 tx=0).stop 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.571+0000 7fc1dd000640 1 -- 172.21.15.2:0/3660296237 reap_dead start 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.571+0000 7fc1df000640 1 -- 172.21.15.2:0/3660296237 shutdown_connections 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.571+0000 7fc1df000640 1 -- 172.21.15.2:0/3660296237 >> 172.21.15.2:0/3660296237 conn(0x7fc1d8074850 msgr2=0x7fc1d80b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.571+0000 7fc1df000640 1 -- 172.21.15.2:0/3660296237 shutdown_connections 2024-05-14T15:15:23.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.571+0000 7fc1df000640 1 -- 172.21.15.2:0/3660296237 wait complete. 2024-05-14T15:15:23.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.574+0000 7fc1df000640 1 Processor -- start 2024-05-14T15:15:23.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.574+0000 7fc1df000640 1 -- start start 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1df000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 0x7fc1d815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1df000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80b0820 0x7fc1d80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1df000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1d815bd30 0x7fc1d815c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1df000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d806d100 con 0x7fc1bc0040d0 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1df000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d806cf80 con 0x7fc1d815bd30 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1df000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d806d280 con 0x7fc1d80b0820 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1d7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 0x7fc1d815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1d7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 0x7fc1d815e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53722/0 (socket says 172.21.15.2:53722) 2024-05-14T15:15:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1d7e00640 1 -- 172.21.15.2:0/4099928955 learned_addr learned my addr 172.21.15.2:0/4099928955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.576+0000 7fc1cfe00640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80b0820 0x7fc1d80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1dd000640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1d815bd30 0x7fc1d815c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1d7e00640 1 -- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80b0820 msgr2=0x7fc1d80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80b0820 0x7fc1d80b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1d7e00640 1 -- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1d815bd30 msgr2=0x7fc1d815c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1d815bd30 0x7fc1d815c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1d7e00640 1 -- 172.21.15.2:0/4099928955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d815c680 con 0x7fc1bc0040d0 2024-05-14T15:15:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.577+0000 7fc1d7e00640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 0x7fc1d815e6a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800f550 tx=0x7fc1c800fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.578+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8019020 con 0x7fc1bc0040d0 2024-05-14T15:15:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.579+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c8014870 con 0x7fc1bc0040d0 2024-05-14T15:15:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.579+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d81f5170 con 0x7fc1bc0040d0 2024-05-14T15:15:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.579+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8014c60 con 0x7fc1bc0040d0 2024-05-14T15:15:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.579+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d81f5730 con 0x7fc1bc0040d0 2024-05-14T15:15:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.579+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1c801c020 con 0x7fc1bc0040d0 2024-05-14T15:15:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.579+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc1c801e400 con 0x7fc1bc0040d0 2024-05-14T15:15:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.580+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d8050870 con 0x7fc1bc0040d0 2024-05-14T15:15:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.585+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc1c8023020 con 0x7fc1bc0040d0 2024-05-14T15:15:23.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.659+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc1d80b3c00 con 0x7fc1bc0040d0 2024-05-14T15:15:23.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.661+0000 7fc1d4c00640 1 -- 172.21.15.2:0/4099928955 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fc1d815c680 con 0x7fc1bc0040d0 2024-05-14T15:15:23.660 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 msgr2=0x7fc1d815e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 0x7fc1d815e6a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800f550 tx=0x7fc1c800fa10 comp rx=0 tx=0).stop 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 shutdown_connections 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1d815bd30 0x7fc1d815c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1d80b0820 0x7fc1d80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 --2- 172.21.15.2:0/4099928955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1bc0040d0 0x7fc1d815e6a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 >> 172.21.15.2:0/4099928955 conn(0x7fc1d8074850 msgr2=0x7fc1d806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 shutdown_connections 2024-05-14T15:15:23.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:23.663+0000 7fc1df000640 1 -- 172.21.15.2:0/4099928955 wait complete. 2024-05-14T15:15:23.686 INFO:tasks.ceph:check_enable_crimson: False 2024-05-14T15:15:23.686 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-14T15:15:23.687 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:23.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-14T15:15:23.707 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:23.710+0000 7fd780237040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:15:23.713 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:23.715+0000 7f442231e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:15:23.750 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:23.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-14T15:15:23.873 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:23.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-14T15:15:23.896 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:23.898+0000 7fd780237040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:15:23.901 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:23.902+0000 7f442231e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:15:23.959 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:23.961+0000 7fd780237040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:15:23.966 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:23.967+0000 7f442231e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:15:23.983 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:23.983 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-14T15:15:24.063 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:24.063 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-14T15:15:24.136 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:24.136 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-14T15:15:24.246 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:24.248+0000 7fd780237040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:15:24.252 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:24.252 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-14T15:15:24.266 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:24.267+0000 7f442231e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:15:24.301 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:24.304+0000 7fd780237040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:15:24.323 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:24.323+0000 7f442231e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:15:24.364 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:15:24.364 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-14T15:15:24.478 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new b15320c4-daa5-4174-a709-b8cc549256cb 0 2024-05-14T15:15:24.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.775+0000 7f2568400640 1 Processor -- start 2024-05-14T15:15:24.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.775+0000 7f2568400640 1 -- start start 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.777+0000 7f2568400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25600d0f10 0x7f2560160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.777+0000 7f2568400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600d3d80 0x7f256015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.777+0000 7f2568400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25600d42f0 con 0x7f25600d5390 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.777+0000 7f2568400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f25600d4f00 con 0x7f25600d0f10 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.777+0000 7f2568400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f25600d45d0 con 0x7f25600d3d80 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2565a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f25600d5390 0x7f25600d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45692/0 (socket says 172.21.15.156:45692) 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2566400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600d3d80 0x7f256015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2565a00640 1 -- 172.21.15.156:0/1411892783 learned_addr learned my addr 172.21.15.156:0/1411892783 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-05-14T15:15:24.776 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2565000640 1 --2- 172.21.15.156:0/1411892783 >> v2:172.21.15.2:3300/0 conn(0x7f25600d0f10 0x7f2560160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:24.777 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2566400640 1 -- 172.21.15.156:0/1411892783 >> v2:172.21.15.2:3300/0 conn(0x7f25600d0f10 msgr2=0x7f2560160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:24.777 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2566400640 1 --2- 172.21.15.156:0/1411892783 >> v2:172.21.15.2:3300/0 conn(0x7f25600d0f10 0x7f2560160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.777 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f255fe00640 1 -- 172.21.15.156:0/1411892783 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339981985 0 0) 0x7f25600d42f0 con 0x7f25600d5390 2024-05-14T15:15:24.777 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2566400640 1 -- 172.21.15.156:0/1411892783 >> v1:172.21.15.156:6789/0 conn(0x7f25600d5390 legacy=0x7f25600d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:24.777 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.778+0000 7f2566400640 1 -- 172.21.15.156:0/1411892783 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25600d48b0 con 0x7f25600d3d80 2024-05-14T15:15:24.778 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.779+0000 7f2566400640 1 --2- 172.21.15.156:0/1411892783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600d3d80 0x7f256015dd40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f25580097a0 tx=0x7f255802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09df47dc1c89d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:24.778 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.780+0000 7f255fe00640 1 -- 172.21.15.156:0/1411892783 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558037070 con 0x7f25600d3d80 2024-05-14T15:15:24.778 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.780+0000 7f255fe00640 1 -- 172.21.15.156:0/1411892783 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2558032440 con 0x7f25600d3d80 2024-05-14T15:15:24.778 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.780+0000 7f255fe00640 1 -- 172.21.15.156:0/1411892783 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558032810 con 0x7f25600d3d80 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.780+0000 7f2568400640 1 -- 172.21.15.156:0/1411892783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600d3d80 msgr2=0x7f256015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.780+0000 7f2568400640 1 --2- 172.21.15.156:0/1411892783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600d3d80 0x7f256015dd40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f25580097a0 tx=0x7f255802a180 comp rx=0 tx=0).stop 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.781+0000 7f2568400640 1 -- 172.21.15.156:0/1411892783 shutdown_connections 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.781+0000 7f2568400640 1 --2- 172.21.15.156:0/1411892783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600d3d80 0x7f256015dd40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.781+0000 7f2568400640 1 --2- 172.21.15.156:0/1411892783 >> v2:172.21.15.2:3300/0 conn(0x7f25600d0f10 0x7f2560160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.781+0000 7f2568400640 1 -- 172.21.15.156:0/1411892783 >> 172.21.15.156:0/1411892783 conn(0x7f25600d2d60 msgr2=0x7f256006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.781+0000 7f2568400640 1 -- 172.21.15.156:0/1411892783 shutdown_connections 2024-05-14T15:15:24.779 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.781+0000 7f2568400640 1 -- 172.21.15.156:0/1411892783 wait complete. 2024-05-14T15:15:24.780 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.783+0000 7f2568400640 1 Processor -- start 2024-05-14T15:15:24.781 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.783+0000 7f2568400640 1 -- start start 2024-05-14T15:15:24.784 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2568400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 0x7f25600cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:24.784 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2568400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25600d5390 0x7f25600cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:24.784 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2568400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600ba050 0x7f25600ba460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:24.784 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2568400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25600d1670 con 0x7f25600d5390 2024-05-14T15:15:24.784 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2568400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f25600d14f0 con 0x7f25600d3d80 2024-05-14T15:15:24.784 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2568400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f25600b4540 con 0x7f25600ba050 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2565a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 0x7f25600cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2565a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 0x7f25600cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51212/0 (socket says 172.21.15.156:51212) 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2565a00640 1 -- 172.21.15.156:0/1486802771 learned_addr learned my addr 172.21.15.156:0/1486802771 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2566400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600ba050 0x7f25600ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2565000640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25600d5390 0x7f25600cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2566400640 1 -- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 msgr2=0x7f25600cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2566400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 0x7f25600cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2566400640 1 -- 172.21.15.156:0/1486802771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25600d5390 msgr2=0x7f25600cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2566400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25600d5390 0x7f25600cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2566400640 1 -- 172.21.15.156:0/1486802771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25600ba9a0 con 0x7f25600ba050 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2565000640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25600d5390 0x7f25600cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.785+0000 7f2565a00640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 0x7f25600cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f2566400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600ba050 0x7f25600ba460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2558031000 tx=0x7f25580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:24.785 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558032e60 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25580306f0 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256015ab30 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558037040 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f256015add0 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.786+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2558044020 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.787+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f255803dd30 con 0x7f25600ba050 2024-05-14T15:15:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.787+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25600ce330 con 0x7f25600ba050 2024-05-14T15:15:24.788 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.791+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f25600ba9a0 con 0x7f25600ba050 2024-05-14T15:15:24.864 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.866+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b15320c4-daa5-4174-a709-b8cc549256cb", "id": 0} v 0) -- 0x7f25600d0e70 con 0x7f25600ba050 2024-05-14T15:15:24.870 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.873+0000 7f255d600640 1 -- 172.21.15.156:0/1486802771 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b15320c4-daa5-4174-a709-b8cc549256cb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f25600d0e70 con 0x7f25600ba050 2024-05-14T15:15:24.870 INFO:teuthology.orchestra.run.smithi156.stdout:0 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600ba050 msgr2=0x7f25600ba460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600ba050 0x7f25600ba460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2558031000 tx=0x7f25580046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 shutdown_connections 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25600ba050 0x7f25600ba460 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25600d5390 0x7f25600cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 --2- 172.21.15.156:0/1486802771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25600d3d80 0x7f25600cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 >> 172.21.15.156:0/1486802771 conn(0x7f25600d2d60 msgr2=0x7f25600d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 shutdown_connections 2024-05-14T15:15:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:24.874+0000 7f2568400640 1 -- 172.21.15.156:0/1486802771 wait complete. 2024-05-14T15:15:24.893 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new a1deaf7a-40ad-458f-85c0-aadf6ef78c0e 1 2024-05-14T15:15:25.137 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.140+0000 7f6b15400640 1 Processor -- start 2024-05-14T15:15:25.137 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.140+0000 7f6b15400640 1 -- start start 2024-05-14T15:15:25.139 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b15400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b10161f10 0x7f6b100cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b15400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b100cfc70 0x7f6b100d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b15400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b100b0360 con 0x7f6b100af630 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b15400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100b0f70 con 0x7f6b10161f10 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b15400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100b0640 con 0x7f6b100cfc70 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b14a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b100cfc70 0x7f6b100d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b0fe00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6b100af630 0x7f6b10161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45706/0 (socket says 172.21.15.156:45706) 2024-05-14T15:15:25.140 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.142+0000 7f6b0fe00640 1 -- 172.21.15.156:0/139861514 learned_addr learned my addr 172.21.15.156:0/139861514 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b0f400640 1 --2- 172.21.15.156:0/139861514 >> v2:172.21.15.2:3300/0 conn(0x7f6b10161f10 0x7f6b100cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b14a00640 1 -- 172.21.15.156:0/139861514 >> v2:172.21.15.2:3300/0 conn(0x7f6b10161f10 msgr2=0x7f6b100cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b14a00640 1 --2- 172.21.15.156:0/139861514 >> v2:172.21.15.2:3300/0 conn(0x7f6b10161f10 0x7f6b100cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b14a00640 1 -- 172.21.15.156:0/139861514 >> v1:172.21.15.156:6789/0 conn(0x7f6b100af630 legacy=0x7f6b10161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b14a00640 1 -- 172.21.15.156:0/139861514 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100b0920 con 0x7f6b100cfc70 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b0ea00640 1 -- 172.21.15.156:0/139861514 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212874264 0 0) 0x7f6b100b0360 con 0x7f6b100af630 2024-05-14T15:15:25.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.143+0000 7f6b0f400640 1 --2- 172.21.15.156:0/139861514 >> v2:172.21.15.2:3300/0 conn(0x7f6b10161f10 0x7f6b100cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:25.142 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.144+0000 7f6b14a00640 1 --2- 172.21.15.156:0/139861514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b100cfc70 0x7f6b100d0080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b100b69f0 tx=0x7f6b0802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c23f2b5a798c03 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:25.142 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.144+0000 7f6b0ea00640 1 -- 172.21.15.156:0/139861514 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08007740 con 0x7f6b100cfc70 2024-05-14T15:15:25.142 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.144+0000 7f6b0ea00640 1 -- 172.21.15.156:0/139861514 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b080078e0 con 0x7f6b100cfc70 2024-05-14T15:15:25.142 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.144+0000 7f6b0ea00640 1 -- 172.21.15.156:0/139861514 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08007cb0 con 0x7f6b100cfc70 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 -- 172.21.15.156:0/139861514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b100cfc70 msgr2=0x7f6b100d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 --2- 172.21.15.156:0/139861514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b100cfc70 0x7f6b100d0080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b100b69f0 tx=0x7f6b0802a5f0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 -- 172.21.15.156:0/139861514 shutdown_connections 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 --2- 172.21.15.156:0/139861514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b100cfc70 0x7f6b100d0080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 --2- 172.21.15.156:0/139861514 >> v2:172.21.15.2:3300/0 conn(0x7f6b10161f10 0x7f6b100cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 -- 172.21.15.156:0/139861514 >> 172.21.15.156:0/139861514 conn(0x7f6b100739a0 msgr2=0x7f6b10073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 -- 172.21.15.156:0/139861514 shutdown_connections 2024-05-14T15:15:25.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.145+0000 7f6b15400640 1 -- 172.21.15.156:0/139861514 wait complete. 2024-05-14T15:15:25.145 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.148+0000 7f6b15400640 1 Processor -- start 2024-05-14T15:15:25.146 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.148+0000 7f6b15400640 1 -- start start 2024-05-14T15:15:25.152 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b15400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b100af630 0x7f6b101f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.152 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b15400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 0x7f6b1015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.153 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b15400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b1009ead0 0x7f6b1015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.153 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b15400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100afa40 con 0x7f6b100af630 2024-05-14T15:15:25.153 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b15400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10162560 con 0x7f6b1009ead0 2024-05-14T15:15:25.153 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b15400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6b100afbc0 con 0x7f6b100cfc70 2024-05-14T15:15:25.153 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b14a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b1009ead0 0x7f6b1015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.153 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b0f400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 0x7f6b1015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.154 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b14a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b1009ead0 0x7f6b1015d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51238/0 (socket says 172.21.15.156:51238) 2024-05-14T15:15:25.154 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b0f400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 0x7f6b1015cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58288/0 (socket says 172.21.15.156:58288) 2024-05-14T15:15:25.154 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b14a00640 1 -- 172.21.15.156:0/1177266112 learned_addr learned my addr 172.21.15.156:0/1177266112 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:25.154 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.150+0000 7f6b0fe00640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b100af630 0x7f6b101f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.154 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b0f400640 1 -- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b1009ead0 msgr2=0x7f6b1015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.155 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b0f400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b1009ead0 0x7f6b1015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.155 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b0f400640 1 -- 172.21.15.156:0/1177266112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b100af630 msgr2=0x7f6b101f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.155 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b0f400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b100af630 0x7f6b101f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.155 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b0f400640 1 -- 172.21.15.156:0/1177266112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b10152490 con 0x7f6b100cfc70 2024-05-14T15:15:25.155 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b0f400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 0x7f6b1015cce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c5e0 tx=0x7f6afc00caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:25.155 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc015070 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc011800 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc011bd0 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.151+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b101f6ee0 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.152+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b101f75f0 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.152+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6afc018070 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.152+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6afc023750 con 0x7f6b100cfc70 2024-05-14T15:15:25.156 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.153+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b10050870 con 0x7f6b100cfc70 2024-05-14T15:15:25.157 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.155+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6b10152490 con 0x7f6b100cfc70 2024-05-14T15:15:25.232 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.235+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a1deaf7a-40ad-458f-85c0-aadf6ef78c0e", "id": 1} v 0) -- 0x7f6b101f7310 con 0x7f6b100cfc70 2024-05-14T15:15:25.240 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.243+0000 7f6b07e00640 1 -- 172.21.15.156:0/1177266112 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1deaf7a-40ad-458f-85c0-aadf6ef78c0e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6afc023950 con 0x7f6b100cfc70 2024-05-14T15:15:25.241 INFO:teuthology.orchestra.run.smithi156.stdout:1 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 msgr2=0x7f6b1015cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 0x7f6b1015cce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c5e0 tx=0x7f6afc00caa0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 shutdown_connections 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b1009ead0 0x7f6b1015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b100cfc70 0x7f6b1015cce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 --2- 172.21.15.156:0/1177266112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b100af630 0x7f6b101f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 >> 172.21.15.156:0/1177266112 conn(0x7f6b100739a0 msgr2=0x7f6b1015f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 shutdown_connections 2024-05-14T15:15:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.244+0000 7f6b15400640 1 -- 172.21.15.156:0/1177266112 wait complete. 2024-05-14T15:15:25.259 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.261+0000 7fd780237040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:15:25.265 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 3801e264-cb7c-4046-945d-74be2c93e418 2 2024-05-14T15:15:25.364 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:25.365+0000 7f442231e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:15:25.375 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.378+0000 7fd780237040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:15:25.432 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.434+0000 7fd780237040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:15:25.474 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:25.475+0000 7f442231e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:15:25.520 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.522+0000 7f440f200640 1 Processor -- start 2024-05-14T15:15:25.520 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.523+0000 7f440f200640 1 -- start start 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440f200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 0x7f44100d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440f200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 0x7f44100b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440f200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44100b9530 0x7f44100d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440f200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f44100b4ed0 con 0x7f44100b9530 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440f200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f44100d54d0 con 0x7f4410160210 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440f200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f441006c820 con 0x7f44100d4f10 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f440de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 0x7f44100d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.525+0000 7f4407e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 0x7f44100b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f440de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 0x7f44100d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51240/0 (socket says 172.21.15.156:51240) 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f4407e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 0x7f44100b8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58296/0 (socket says 172.21.15.156:58296) 2024-05-14T15:15:25.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f440de00640 1 -- 172.21.15.156:0/1993424217 learned_addr learned my addr 172.21.15.156:0/1993424217 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f440e800640 1 --2- 172.21.15.156:0/1993424217 >> v2:172.21.15.2:3300/0 conn(0x7f44100b9530 0x7f44100d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f4407e00640 1 -- 172.21.15.156:0/1993424217 >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 msgr2=0x7f44100d3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f4407e00640 1 --2- 172.21.15.156:0/1993424217 >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 0x7f44100d3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f4407e00640 1 -- 172.21.15.156:0/1993424217 >> v2:172.21.15.2:3300/0 conn(0x7f44100b9530 msgr2=0x7f44100d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f4407e00640 1 --2- 172.21.15.156:0/1993424217 >> v2:172.21.15.2:3300/0 conn(0x7f44100b9530 0x7f44100d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f4407e00640 1 -- 172.21.15.156:0/1993424217 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441006cb00 con 0x7f44100d4f10 2024-05-14T15:15:25.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.526+0000 7f440de00640 1 --2- 172.21.15.156:0/1993424217 >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 0x7f44100d3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:25.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.527+0000 7f4407e00640 1 --2- 172.21.15.156:0/1993424217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 0x7f44100b8ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f441008e690 tx=0x7f43f802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28f3b2448ae3eef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:25.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.527+0000 7f440d400640 1 -- 172.21.15.156:0/1993424217 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8037070 con 0x7f44100d4f10 2024-05-14T15:15:25.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440d400640 1 -- 172.21.15.156:0/1993424217 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f802add0 con 0x7f44100d4f10 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440d400640 1 -- 172.21.15.156:0/1993424217 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8032660 con 0x7f44100d4f10 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 -- 172.21.15.156:0/1993424217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 msgr2=0x7f44100b8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 --2- 172.21.15.156:0/1993424217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 0x7f44100b8ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f441008e690 tx=0x7f43f802a080 comp rx=0 tx=0).stop 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 -- 172.21.15.156:0/1993424217 shutdown_connections 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 --2- 172.21.15.156:0/1993424217 >> v2:172.21.15.2:3300/0 conn(0x7f44100b9530 0x7f44100d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 --2- 172.21.15.156:0/1993424217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100d4f10 0x7f44100b8ff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 --2- 172.21.15.156:0/1993424217 >> v2:172.21.15.156:3300/0 conn(0x7f4410160210 0x7f44100d3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.528+0000 7f440f200640 1 -- 172.21.15.156:0/1993424217 >> 172.21.15.156:0/1993424217 conn(0x7f44100d6050 msgr2=0x7f44100d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.529+0000 7f440f200640 1 -- 172.21.15.156:0/1993424217 shutdown_connections 2024-05-14T15:15:25.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.529+0000 7f440f200640 1 -- 172.21.15.156:0/1993424217 wait complete. 2024-05-14T15:15:25.528 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:25.528+0000 7f442231e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:15:25.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.531+0000 7f440f200640 1 Processor -- start 2024-05-14T15:15:25.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.531+0000 7f440f200640 1 -- start start 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.532+0000 7f440f200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 0x7f4410161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.532+0000 7f440f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 0x7f44100ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.532+0000 7f440f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4410160210 0x7f44100cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.532+0000 7f440f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44100d0e50 con 0x7f4410160210 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.532+0000 7f440f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f441006d0c0 con 0x7f44100d4f10 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.532+0000 7f440f200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f44100d0fd0 con 0x7f44100b9530 2024-05-14T15:15:25.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 0x7f44100ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f440de00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 0x7f4410161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 0x7f44100ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51246/0 (socket says 172.21.15.156:51246) 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f440de00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 0x7f4410161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58302/0 (socket says 172.21.15.156:58302) 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 -- 172.21.15.156:0/2622436008 learned_addr learned my addr 172.21.15.156:0/2622436008 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f440e800640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4410160210 0x7f44100cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 -- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 msgr2=0x7f4410161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.532 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 0x7f4410161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 -- 172.21.15.156:0/2622436008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4410160210 msgr2=0x7f44100cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4410160210 0x7f44100cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 -- 172.21.15.156:0/2622436008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44100cbdb0 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f440de00640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 0x7f4410161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.533+0000 7f4407e00640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 0x7f44100ce440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009890 tx=0x7f43f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8037040 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f8042070 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f803d660 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44100cedb0 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4410160b70 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f43f803d800 con 0x7f44100d4f10 2024-05-14T15:15:25.533 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.534+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f43f8047d80 con 0x7f44100d4f10 2024-05-14T15:15:25.534 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.535+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4410160680 con 0x7f44100d4f10 2024-05-14T15:15:25.535 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.538+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f44100cbdb0 con 0x7f44100d4f10 2024-05-14T15:15:25.616 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.618+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3801e264-cb7c-4046-945d-74be2c93e418", "id": 2} v 0) -- 0x7f4410050870 con 0x7f44100d4f10 2024-05-14T15:15:25.626 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.629+0000 7f4406000640 1 -- 172.21.15.156:0/2622436008 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3801e264-cb7c-4046-945d-74be2c93e418", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f43f8047460 con 0x7f44100d4f10 2024-05-14T15:15:25.627 INFO:teuthology.orchestra.run.smithi156.stdout:2 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 msgr2=0x7f44100ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 0x7f44100ce440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009890 tx=0x7f43f80046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 shutdown_connections 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44100d4f10 0x7f44100ce440 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4410160210 0x7f44100cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 --2- 172.21.15.156:0/2622436008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44100b9530 0x7f4410161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 >> 172.21.15.156:0/2622436008 conn(0x7f44100d6050 msgr2=0x7f441015eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 shutdown_connections 2024-05-14T15:15:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.630+0000 7f440f200640 1 -- 172.21.15.156:0/2622436008 wait complete. 2024-05-14T15:15:25.635 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.638+0000 7fd780237040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:15:25.652 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 2d934743-8594-4f6d-a6cb-02dda84df2d8 3 2024-05-14T15:15:25.705 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.707+0000 7fd780237040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:15:25.736 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:25.737+0000 7f442231e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:15:25.770 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.772+0000 7fd780237040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:15:25.816 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:25.817+0000 7f442231e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:15:25.886 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:25.886+0000 7f442231e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:15:25.905 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.908+0000 7fee4a800640 1 Processor -- start 2024-05-14T15:15:25.906 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.908+0000 7fee4a800640 1 -- start start 2024-05-14T15:15:25.906 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:25.908+0000 7fd780237040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:15:25.908 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.910+0000 7fee4a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 0x7fee440d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.910+0000 7fee4a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fee440d0ee0 0x7fee44163a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.910+0000 7fee4a800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee44164360 con 0x7fee44163f50 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.910+0000 7fee4a800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fee440d4810 con 0x7fee440d0ee0 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.910+0000 7fee4a800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fee440d4af0 con 0x7fee4415db90 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.910+0000 7fee49400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 0x7fee440d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee49400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 0x7fee440d41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58308/0 (socket says 172.21.15.156:58308) 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee49400640 1 -- 172.21.15.156:0/2903058773 learned_addr learned my addr 172.21.15.156:0/2903058773 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee48a00640 1 --2- 172.21.15.156:0/2903058773 >> v2:172.21.15.2:3300/0 conn(0x7fee440d0ee0 0x7fee44163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee49400640 1 -- 172.21.15.156:0/2903058773 >> v2:172.21.15.2:3300/0 conn(0x7fee440d0ee0 msgr2=0x7fee44163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee49400640 1 --2- 172.21.15.156:0/2903058773 >> v2:172.21.15.2:3300/0 conn(0x7fee440d0ee0 0x7fee44163a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee49400640 1 -- 172.21.15.156:0/2903058773 >> v1:172.21.15.2:6789/0 conn(0x7fee44163f50 legacy=0x7fee440b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.911+0000 7fee49400640 1 -- 172.21.15.156:0/2903058773 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee440d4dd0 con 0x7fee4415db90 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.912+0000 7fee49400640 1 --2- 172.21.15.156:0/2903058773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 0x7fee440d41a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee38009870 tx=0x7fee3802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b159155359aca7be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.912+0000 7fee43e00640 1 -- 172.21.15.156:0/2903058773 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38037070 con 0x7fee4415db90 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.912+0000 7fee43e00640 1 -- 172.21.15.156:0/2903058773 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee38032440 con 0x7fee4415db90 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.912+0000 7fee43e00640 1 -- 172.21.15.156:0/2903058773 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38032810 con 0x7fee4415db90 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 -- 172.21.15.156:0/2903058773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 msgr2=0x7fee440d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 --2- 172.21.15.156:0/2903058773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 0x7fee440d41a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee38009870 tx=0x7fee3802a130 comp rx=0 tx=0).stop 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 -- 172.21.15.156:0/2903058773 shutdown_connections 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 --2- 172.21.15.156:0/2903058773 >> v2:172.21.15.2:3300/0 conn(0x7fee440d0ee0 0x7fee44163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 --2- 172.21.15.156:0/2903058773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee4415db90 0x7fee440d41a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 -- 172.21.15.156:0/2903058773 >> 172.21.15.156:0/2903058773 conn(0x7fee440d6040 msgr2=0x7fee440b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:25.912 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 -- 172.21.15.156:0/2903058773 shutdown_connections 2024-05-14T15:15:25.912 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.913+0000 7fee4a800640 1 -- 172.21.15.156:0/2903058773 wait complete. 2024-05-14T15:15:25.913 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.916+0000 7fee4a800640 1 Processor -- start 2024-05-14T15:15:25.913 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.916+0000 7fee4a800640 1 -- start start 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.917+0000 7fee4a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 0x7fee440cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.917+0000 7fee4a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4415db90 0x7fee440cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.917+0000 7fee4a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee44163f50 0x7fee441f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.917+0000 7fee4a800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee440d1470 con 0x7fee4415db90 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.917+0000 7fee4a800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fee440d12f0 con 0x7fee44163f50 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.917+0000 7fee4a800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fee440b4bd0 con 0x7fee440d0ee0 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 0x7fee440cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 0x7fee440cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58316/0 (socket says 172.21.15.156:58316) 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 -- 172.21.15.156:0/4177517801 learned_addr learned my addr 172.21.15.156:0/4177517801 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49e00640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee44163f50 0x7fee441f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.917 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee48a00640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4415db90 0x7fee440cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 -- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee44163f50 msgr2=0x7fee441f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee44163f50 0x7fee441f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 -- 172.21.15.156:0/4177517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4415db90 msgr2=0x7fee440cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4415db90 0x7fee440cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 -- 172.21.15.156:0/4177517801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee440caae0 con 0x7fee440d0ee0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49e00640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee44163f50 0x7fee441f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee48a00640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4415db90 0x7fee440cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.918+0000 7fee49400640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 0x7fee440cf690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee38009870 tx=0x7fee380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38041070 con 0x7fee440d0ee0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3803c890 con 0x7fee440d0ee0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee440cadc0 con 0x7fee440d0ee0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38037040 con 0x7fee440d0ee0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee440cb380 con 0x7fee440d0ee0 2024-05-14T15:15:25.918 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee38044070 con 0x7fee440d0ee0 2024-05-14T15:15:25.919 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.919+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fee3803d3f0 con 0x7fee440d0ee0 2024-05-14T15:15:25.919 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.920+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee44050870 con 0x7fee440d0ee0 2024-05-14T15:15:25.920 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:25.923+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fee44164360 con 0x7fee440d0ee0 2024-05-14T15:15:26.001 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.004+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d934743-8594-4f6d-a6cb-02dda84df2d8", "id": 3} v 0) -- 0x7fee440d3d50 con 0x7fee440d0ee0 2024-05-14T15:15:26.009 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.012+0000 7fee41600640 1 -- 172.21.15.156:0/4177517801 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d934743-8594-4f6d-a6cb-02dda84df2d8", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fee3803cc80 con 0x7fee440d0ee0 2024-05-14T15:15:26.009 INFO:teuthology.orchestra.run.smithi156.stdout:3 2024-05-14T15:15:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 msgr2=0x7fee440cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 0x7fee440cf690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee38009870 tx=0x7fee380046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 shutdown_connections 2024-05-14T15:15:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee44163f50 0x7fee441f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4415db90 0x7fee440cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 --2- 172.21.15.156:0/4177517801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee440d0ee0 0x7fee440cf690 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.013+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 >> 172.21.15.156:0/4177517801 conn(0x7fee440d6040 msgr2=0x7fee4415cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.014+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 shutdown_connections 2024-05-14T15:15:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.014+0000 7fee4a800640 1 -- 172.21.15.156:0/4177517801 wait complete. 2024-05-14T15:15:26.027 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:26.028+0000 7f442231e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:15:26.034 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 665abbaf-7c1d-46bd-9fbd-c8a5bc65972b 4 2024-05-14T15:15:26.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.290+0000 7fcb43200640 1 Processor -- start 2024-05-14T15:15:26.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.290+0000 7fcb43200640 1 -- start start 2024-05-14T15:15:26.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb43200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440d2e20 0x7fcb4415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb43200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb440b2f40 con 0x7fcb44164240 2024-05-14T15:15:26.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb43200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb440b2c60 con 0x7fcb440cf530 2024-05-14T15:15:26.293 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb43200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcb44160490 con 0x7fcb440d2e20 2024-05-14T15:15:26.293 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb41e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcb440cf530 0x7fcb44163b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45712/0 (socket says 172.21.15.156:45712) 2024-05-14T15:15:26.293 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb41e00640 1 -- 172.21.15.156:0/1847181366 learned_addr learned my addr 172.21.15.156:0/1847181366 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-05-14T15:15:26.293 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.293+0000 7fcb3be00640 1 --2- 172.21.15.156:0/1847181366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440d2e20 0x7fcb4415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.293 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.294+0000 7fcb3be00640 1 -- 172.21.15.156:0/1847181366 >> v1:172.21.15.156:6789/0 conn(0x7fcb440cf530 legacy=0x7fcb44163b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.294 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.294+0000 7fcb3be00640 1 -- 172.21.15.156:0/1847181366 >> v1:172.21.15.2:6789/0 conn(0x7fcb44164240 legacy=0x7fcb440cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:26.294 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.294+0000 7fcb41400640 1 -- 172.21.15.156:0/1847181366 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449557994 0 0) 0x7fcb440b2c60 con 0x7fcb440cf530 2024-05-14T15:15:26.294 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.294+0000 7fcb3be00640 1 -- 172.21.15.156:0/1847181366 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb440d0510 con 0x7fcb440d2e20 2024-05-14T15:15:26.294 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.295+0000 7fcb3be00640 1 --2- 172.21.15.156:0/1847181366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440d2e20 0x7fcb4415ff50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0097d0 tx=0x7fcb2c02a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43abd3d07d3a048 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:26.295 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.295+0000 7fcb41400640 1 -- 172.21.15.156:0/1847181366 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c037070 con 0x7fcb440d2e20 2024-05-14T15:15:26.295 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.295+0000 7fcb41400640 1 -- 172.21.15.156:0/1847181366 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2c02ae20 con 0x7fcb440d2e20 2024-05-14T15:15:26.295 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.295+0000 7fcb41400640 1 -- 172.21.15.156:0/1847181366 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c032660 con 0x7fcb440d2e20 2024-05-14T15:15:26.295 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 -- 172.21.15.156:0/1847181366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440d2e20 msgr2=0x7fcb4415ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.295 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 --2- 172.21.15.156:0/1847181366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440d2e20 0x7fcb4415ff50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0097d0 tx=0x7fcb2c02a0d0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 -- 172.21.15.156:0/1847181366 shutdown_connections 2024-05-14T15:15:26.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 --2- 172.21.15.156:0/1847181366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440d2e20 0x7fcb4415ff50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 -- 172.21.15.156:0/1847181366 >> 172.21.15.156:0/1847181366 conn(0x7fcb440b52e0 msgr2=0x7fcb440b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:26.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 -- 172.21.15.156:0/1847181366 shutdown_connections 2024-05-14T15:15:26.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.296+0000 7fcb43200640 1 -- 172.21.15.156:0/1847181366 wait complete. 2024-05-14T15:15:26.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.298+0000 7fcb43200640 1 Processor -- start 2024-05-14T15:15:26.297 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.298+0000 7fcb43200640 1 -- start start 2024-05-14T15:15:26.297 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb43200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440cf530 0x7fcb44070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb43200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 0x7fcb4406fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb43200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb44164240 0x7fcb44162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb43200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44164650 con 0x7fcb44164240 2024-05-14T15:15:26.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb43200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44164a40 con 0x7fcb440d2e20 2024-05-14T15:15:26.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb43200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcb441647d0 con 0x7fcb440cf530 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb3be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 0x7fcb4406fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb41e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440cf530 0x7fcb44070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb3be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 0x7fcb4406fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51256/0 (socket says 172.21.15.156:51256) 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb3be00640 1 -- 172.21.15.156:0/973854364 learned_addr learned my addr 172.21.15.156:0/973854364 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.300+0000 7fcb42800640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb44164240 0x7fcb44162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb41e00640 1 -- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 msgr2=0x7fcb4406fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb41e00640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 0x7fcb4406fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb41e00640 1 -- 172.21.15.156:0/973854364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb44164240 msgr2=0x7fcb44162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb41e00640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb44164240 0x7fcb44162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb41e00640 1 -- 172.21.15.156:0/973854364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb441e9ee0 con 0x7fcb440cf530 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb3be00640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 0x7fcb4406fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb42800640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb44164240 0x7fcb44162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb41e00640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440cf530 0x7fcb44070920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcb44074810 tx=0x7fcb3400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:26.302 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340074e0 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb340047e0 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34004bd0 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb441ea1c0 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.301+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb441ea780 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.302+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcb34011070 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.302+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcb34004d70 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.302+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb44050870 con 0x7fcb440cf530 2024-05-14T15:15:26.303 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.305+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcb3401d3f0 con 0x7fcb440cf530 2024-05-14T15:15:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.383+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "665abbaf-7c1d-46bd-9fbd-c8a5bc65972b", "id": 4} v 0) -- 0x7fcb440d2c00 con 0x7fcb440cf530 2024-05-14T15:15:26.389 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:26.392+0000 7fd780237040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:15:26.390 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.392+0000 7fcb3a000640 1 -- 172.21.15.156:0/973854364 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "665abbaf-7c1d-46bd-9fbd-c8a5bc65972b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fcb3401d5d0 con 0x7fcb440cf530 2024-05-14T15:15:26.390 INFO:teuthology.orchestra.run.smithi156.stdout:4 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440cf530 msgr2=0x7fcb44070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440cf530 0x7fcb44070920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcb44074810 tx=0x7fcb3400c820 comp rx=0 tx=0).stop 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 shutdown_connections 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb440d2e20 0x7fcb4406fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb44164240 0x7fcb44162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 --2- 172.21.15.156:0/973854364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb440cf530 0x7fcb44070920 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 >> 172.21.15.156:0/973854364 conn(0x7fcb440b52e0 msgr2=0x7fcb440b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 shutdown_connections 2024-05-14T15:15:26.392 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.394+0000 7fcb43200640 1 -- 172.21.15.156:0/973854364 wait complete. 2024-05-14T15:15:26.417 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 6685a14d-72ed-43b5-8613-9ec0753f6535 5 2024-05-14T15:15:26.506 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:26.507+0000 7f442231e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:15:26.553 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:26.555+0000 7fd780237040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:15:26.669 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:26.670+0000 7f442231e040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:15:26.670 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.673+0000 7fbe1b000640 1 Processor -- start 2024-05-14T15:15:26.670 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.673+0000 7fbe1b000640 1 -- start start 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe1b000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 0x7fbe140d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe1b000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe140709b0 0x7fbe140b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe1b000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe1415ec60 con 0x7fbe140d1b60 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe1b000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fbe140d1f70 con 0x7fbe140709b0 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe1b000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbe140d2190 con 0x7fbe141554d0 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe19c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 0x7fbe140d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe1a600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe140709b0 0x7fbe140b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe19c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 0x7fbe140d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58340/0 (socket says 172.21.15.156:58340) 2024-05-14T15:15:26.673 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.675+0000 7fbe19c00640 1 -- 172.21.15.156:0/2854309445 learned_addr learned my addr 172.21.15.156:0/2854309445 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.676+0000 7fbe19c00640 1 -- 172.21.15.156:0/2854309445 >> v2:172.21.15.156:3300/0 conn(0x7fbe140709b0 msgr2=0x7fbe140b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.676+0000 7fbe19c00640 1 --2- 172.21.15.156:0/2854309445 >> v2:172.21.15.156:3300/0 conn(0x7fbe140709b0 0x7fbe140b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.676+0000 7fbe13e00640 1 -- 172.21.15.156:0/2854309445 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380095416 0 0) 0x7fbe1415ec60 con 0x7fbe140d1b60 2024-05-14T15:15:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.676+0000 7fbe19c00640 1 -- 172.21.15.156:0/2854309445 >> v1:172.21.15.156:6789/0 conn(0x7fbe140d1b60 legacy=0x7fbe140702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.676+0000 7fbe19c00640 1 -- 172.21.15.156:0/2854309445 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe140d2470 con 0x7fbe141554d0 2024-05-14T15:15:26.675 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.677+0000 7fbe19c00640 1 --2- 172.21.15.156:0/2854309445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 0x7fbe140d1620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009870 tx=0x7fbe0402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29531d06f9e1a6b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:26.675 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.677+0000 7fbe13e00640 1 -- 172.21.15.156:0/2854309445 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04037070 con 0x7fbe141554d0 2024-05-14T15:15:26.675 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.677+0000 7fbe13e00640 1 -- 172.21.15.156:0/2854309445 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe04032440 con 0x7fbe141554d0 2024-05-14T15:15:26.675 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.677+0000 7fbe13e00640 1 -- 172.21.15.156:0/2854309445 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04032810 con 0x7fbe141554d0 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 -- 172.21.15.156:0/2854309445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 msgr2=0x7fbe140d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 --2- 172.21.15.156:0/2854309445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 0x7fbe140d1620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009870 tx=0x7fbe0402a250 comp rx=0 tx=0).stop 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 -- 172.21.15.156:0/2854309445 shutdown_connections 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 --2- 172.21.15.156:0/2854309445 >> v2:172.21.15.156:3300/0 conn(0x7fbe140709b0 0x7fbe140b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 --2- 172.21.15.156:0/2854309445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe141554d0 0x7fbe140d1620 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 -- 172.21.15.156:0/2854309445 >> 172.21.15.156:0/2854309445 conn(0x7fbe140d3720 msgr2=0x7fbe140d3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 -- 172.21.15.156:0/2854309445 shutdown_connections 2024-05-14T15:15:26.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.678+0000 7fbe1b000640 1 -- 172.21.15.156:0/2854309445 wait complete. 2024-05-14T15:15:26.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.681+0000 7fbe1b000640 1 Processor -- start 2024-05-14T15:15:26.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.681+0000 7fbe1b000640 1 -- start start 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.682+0000 7fbe1b000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 0x7fbe141e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.682+0000 7fbe1b000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe141554d0 0x7fbe140c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.682+0000 7fbe1b000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe140cc9e0 0x7fbe141e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.682+0000 7fbe1b000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1415fab0 con 0x7fbe141554d0 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.682+0000 7fbe1b000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbe140ce1f0 con 0x7fbe140d1b60 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.682+0000 7fbe1b000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbe140b2890 con 0x7fbe140cc9e0 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 0x7fbe141e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 0x7fbe141e9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51280/0 (socket says 172.21.15.156:51280) 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 -- 172.21.15.156:0/547773613 learned_addr learned my addr 172.21.15.156:0/547773613 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe1a600640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe140cc9e0 0x7fbe141e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 -- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe140cc9e0 msgr2=0x7fbe141e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe140cc9e0 0x7fbe141e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19200640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe141554d0 0x7fbe140c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:26.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 -- 172.21.15.156:0/547773613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe141554d0 msgr2=0x7fbe140c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe141554d0 0x7fbe140c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 -- 172.21.15.156:0/547773613 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe140ca490 con 0x7fbe140d1b60 2024-05-14T15:15:26.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.683+0000 7fbe19c00640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 0x7fbe141e9ed0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009870 tx=0x7fbe040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04037040 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe04004250 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04003610 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe140c7a00 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe140c7fc0 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe04003b40 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.684+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fbe0403dbc0 con 0x7fbe140d1b60 2024-05-14T15:15:26.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.685+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe14050870 con 0x7fbe140d1b60 2024-05-14T15:15:26.685 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.688+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbe140ca490 con 0x7fbe140d1b60 2024-05-14T15:15:26.764 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.766+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6685a14d-72ed-43b5-8613-9ec0753f6535", "id": 5} v 0) -- 0x7fbe140c9f40 con 0x7fbe140d1b60 2024-05-14T15:15:26.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.773+0000 7fbe11600640 1 -- 172.21.15.156:0/547773613 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6685a14d-72ed-43b5-8613-9ec0753f6535", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fbe0403ddc0 con 0x7fbe140d1b60 2024-05-14T15:15:26.771 INFO:teuthology.orchestra.run.smithi156.stdout:5 2024-05-14T15:15:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 msgr2=0x7fbe141e9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 0x7fbe141e9ed0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009870 tx=0x7fbe040046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 shutdown_connections 2024-05-14T15:15:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe140cc9e0 0x7fbe141e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe141554d0 0x7fbe140c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 --2- 172.21.15.156:0/547773613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe140d1b60 0x7fbe141e9ed0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:26.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 >> 172.21.15.156:0/547773613 conn(0x7fbe140d3720 msgr2=0x7fbe140ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:26.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.774+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 shutdown_connections 2024-05-14T15:15:26.773 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:26.775+0000 7fbe1b000640 1 -- 172.21.15.156:0/547773613 wait complete. 2024-05-14T15:15:26.797 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 70829387-5eab-4f47-8704-689f2c52777c 6 2024-05-14T15:15:26.870 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:26.872+0000 7fd780237040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:15:26.934 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:26.936+0000 7fd780237040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:15:26.984 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:26.985+0000 7f442231e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:15:27.040 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.043+0000 7f9fede00640 1 Processor -- start 2024-05-14T15:15:27.040 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.043+0000 7f9fede00640 1 -- start start 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fede00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fe8160720 0x7f9fe80b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fede00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9fe815d760 0x7f9fe815db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fede00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe8160c90 con 0x7f9fe80cdd80 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fede00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe815ab00 con 0x7f9fe8160720 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fede00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe8160f70 con 0x7f9fe815d760 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fed400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9fe815d760 0x7f9fe815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fe7e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9fe80cdd80 0x7f9fe80b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45736/0 (socket says 172.21.15.156:45736) 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.045+0000 7f9fe7e00640 1 -- 172.21.15.156:0/2250034250 learned_addr learned my addr 172.21.15.156:0/2250034250 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-05-14T15:15:27.043 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9feca00640 1 --2- 172.21.15.156:0/2250034250 >> v2:172.21.15.2:3300/0 conn(0x7f9fe8160720 0x7f9fe80b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.044 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9fed400640 1 -- 172.21.15.156:0/2250034250 >> v2:172.21.15.2:3300/0 conn(0x7f9fe8160720 msgr2=0x7f9fe80b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:27.044 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9fed400640 1 --2- 172.21.15.156:0/2250034250 >> v2:172.21.15.2:3300/0 conn(0x7f9fe8160720 0x7f9fe80b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.044 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9fed400640 1 -- 172.21.15.156:0/2250034250 >> v1:172.21.15.156:6789/0 conn(0x7f9fe80cdd80 legacy=0x7f9fe80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.044 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9fed400640 1 -- 172.21.15.156:0/2250034250 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe8161250 con 0x7f9fe815d760 2024-05-14T15:15:27.044 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9fe7400640 1 -- 172.21.15.156:0/2250034250 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827510205 0 0) 0x7f9fe8160c90 con 0x7f9fe80cdd80 2024-05-14T15:15:27.044 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.046+0000 7f9feca00640 1 --2- 172.21.15.156:0/2250034250 >> v2:172.21.15.2:3300/0 conn(0x7f9fe8160720 0x7f9fe80b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:27.045 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.047+0000 7f9fed400640 1 --2- 172.21.15.156:0/2250034250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe815db70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9fe809fa00 tx=0x7f9fe002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc8f5af7dd290a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:27.045 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.047+0000 7f9fe7400640 1 -- 172.21.15.156:0/2250034250 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0007740 con 0x7f9fe815d760 2024-05-14T15:15:27.045 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.047+0000 7f9fe7400640 1 -- 172.21.15.156:0/2250034250 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00078e0 con 0x7f9fe815d760 2024-05-14T15:15:27.045 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.047+0000 7f9fe7400640 1 -- 172.21.15.156:0/2250034250 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0007cb0 con 0x7f9fe815d760 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 -- 172.21.15.156:0/2250034250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 msgr2=0x7f9fe815db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 --2- 172.21.15.156:0/2250034250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe815db70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9fe809fa00 tx=0x7f9fe002a5f0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 -- 172.21.15.156:0/2250034250 shutdown_connections 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 --2- 172.21.15.156:0/2250034250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe815db70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 --2- 172.21.15.156:0/2250034250 >> v2:172.21.15.2:3300/0 conn(0x7f9fe8160720 0x7f9fe80b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 -- 172.21.15.156:0/2250034250 >> 172.21.15.156:0/2250034250 conn(0x7f9fe80739a0 msgr2=0x7f9fe8073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:27.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.048+0000 7f9fede00640 1 -- 172.21.15.156:0/2250034250 shutdown_connections 2024-05-14T15:15:27.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.049+0000 7f9fede00640 1 -- 172.21.15.156:0/2250034250 wait complete. 2024-05-14T15:15:27.048 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:27.049+0000 7f442231e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:15:27.049 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.051+0000 7f9fede00640 1 Processor -- start 2024-05-14T15:15:27.049 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.051+0000 7f9fede00640 1 -- start start 2024-05-14T15:15:27.052 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.052+0000 7f9fede00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 0x7f9fe81f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.052+0000 7f9fede00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe81fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.052+0000 7f9fede00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8160720 0x7f9fe80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.052+0000 7f9fede00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe80b6a70 con 0x7f9fe8160720 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.052+0000 7f9fede00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8161530 con 0x7f9fe815d760 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.052+0000 7f9fede00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe80b4d80 con 0x7f9fe80cdd80 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 0x7f9fe81f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 0x7f9fe81f9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58360/0 (socket says 172.21.15.156:58360) 2024-05-14T15:15:27.053 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9fe7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe81fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 -- 172.21.15.156:0/2334379387 learned_addr learned my addr 172.21.15.156:0/2334379387 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9fed400640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8160720 0x7f9fe80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 -- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 msgr2=0x7f9fe81fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe81fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 -- 172.21.15.156:0/2334379387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8160720 msgr2=0x7f9fe80cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8160720 0x7f9fe80cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 -- 172.21.15.156:0/2334379387 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe80cecd0 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.053+0000 7f9feca00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 0x7f9fe81f9c70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d7d0 tx=0x7f9fdc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004030 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0041d0 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe80cefb0 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00b660 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe80cf570 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9fdc00b800 con 0x7f9fe80cdd80 2024-05-14T15:15:27.055 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.054+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f9fdc003d90 con 0x7f9fe80cdd80 2024-05-14T15:15:27.056 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.055+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe815a8d0 con 0x7f9fe80cdd80 2024-05-14T15:15:27.056 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.057+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9fe815a8d0 con 0x7f9fe80cdd80 2024-05-14T15:15:27.075 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:27.078+0000 7fd780237040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:15:27.135 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.137+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70829387-5eab-4f47-8704-689f2c52777c", "id": 6} v 0) -- 0x7f9fe80cea30 con 0x7f9fe80cdd80 2024-05-14T15:15:27.141 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.143+0000 7f9fe4c00640 1 -- 172.21.15.156:0/2334379387 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70829387-5eab-4f47-8704-689f2c52777c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f9fdc00bbc0 con 0x7f9fe80cdd80 2024-05-14T15:15:27.141 INFO:teuthology.orchestra.run.smithi156.stdout:6 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 msgr2=0x7f9fe81f9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 0x7f9fe81f9c70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d7d0 tx=0x7f9fdc00dc90 comp rx=0 tx=0).stop 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 shutdown_connections 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe815d760 0x7f9fe81fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8160720 0x7f9fe80cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 --2- 172.21.15.156:0/2334379387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe80cdd80 0x7f9fe81f9c70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 >> 172.21.15.156:0/2334379387 conn(0x7f9fe80739a0 msgr2=0x7f9fe80b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 shutdown_connections 2024-05-14T15:15:27.143 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.145+0000 7f9fede00640 1 -- 172.21.15.156:0/2334379387 wait complete. 2024-05-14T15:15:27.167 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 7d6d4dfb-cc36-4f09-bd95-50f8d37fb849 7 2024-05-14T15:15:27.189 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:27.189+0000 7f442231e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:15:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.413+0000 7f495fe00640 1 Processor -- start 2024-05-14T15:15:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.413+0000 7f495fe00640 1 -- start start 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f496006f4e0 0x7f496015a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49601605a0 0x7f4960070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495fe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49600af720 con 0x7f496009b410 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4960161590 con 0x7f496006f4e0 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495fe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f4960160cf0 con 0x7f49601605a0 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495f400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f496009b410 0x7f496009b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45740/0 (socket says 172.21.15.156:45740) 2024-05-14T15:15:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.415+0000 7f495f400640 1 -- 172.21.15.156:0/1104464617 learned_addr learned my addr 172.21.15.156:0/1104464617 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-05-14T15:15:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f495ea00640 1 --2- 172.21.15.156:0/1104464617 >> v2:172.21.15.2:3300/0 conn(0x7f496006f4e0 0x7f496015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f4957e00640 1 --2- 172.21.15.156:0/1104464617 >> v2:172.21.15.156:3300/0 conn(0x7f49601605a0 0x7f4960070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f495e000640 1 -- 172.21.15.156:0/1104464617 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229026345 0 0) 0x7f4958001490 con 0x7f496009b410 2024-05-14T15:15:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f495e000640 1 -- 172.21.15.156:0/1104464617 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4944003520 con 0x7f496009b410 2024-05-14T15:15:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f4957e00640 1 -- 172.21.15.156:0/1104464617 >> v2:172.21.15.2:3300/0 conn(0x7f496006f4e0 msgr2=0x7f496015a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:27.415 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f4957e00640 1 --2- 172.21.15.156:0/1104464617 >> v2:172.21.15.2:3300/0 conn(0x7f496006f4e0 0x7f496015a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.415 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f4957e00640 1 -- 172.21.15.156:0/1104464617 >> v1:172.21.15.156:6789/0 conn(0x7f496009b410 legacy=0x7f496009b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.415 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.416+0000 7f4957e00640 1 -- 172.21.15.156:0/1104464617 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960160fd0 con 0x7f49601605a0 2024-05-14T15:15:27.416 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.417+0000 7f4957e00640 1 --2- 172.21.15.156:0/1104464617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49601605a0 0x7f4960070ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f496006fb70 tx=0x7f494802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36538b0ef44f9a5c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:27.416 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495e000640 1 -- 172.21.15.156:0/1104464617 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948037070 con 0x7f49601605a0 2024-05-14T15:15:27.416 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495e000640 1 -- 172.21.15.156:0/1104464617 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948032440 con 0x7f49601605a0 2024-05-14T15:15:27.416 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495e000640 1 -- 172.21.15.156:0/1104464617 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494802ae60 con 0x7f49601605a0 2024-05-14T15:15:27.416 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 -- 172.21.15.156:0/1104464617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49601605a0 msgr2=0x7f4960070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 --2- 172.21.15.156:0/1104464617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49601605a0 0x7f4960070ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f496006fb70 tx=0x7f494802a110 comp rx=0 tx=0).stop 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 -- 172.21.15.156:0/1104464617 shutdown_connections 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 --2- 172.21.15.156:0/1104464617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49601605a0 0x7f4960070ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 --2- 172.21.15.156:0/1104464617 >> v2:172.21.15.2:3300/0 conn(0x7f496006f4e0 0x7f496015a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 -- 172.21.15.156:0/1104464617 >> 172.21.15.156:0/1104464617 conn(0x7f49600b7350 msgr2=0x7f49600b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.418+0000 7f495fe00640 1 -- 172.21.15.156:0/1104464617 shutdown_connections 2024-05-14T15:15:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.419+0000 7f495fe00640 1 -- 172.21.15.156:0/1104464617 wait complete. 2024-05-14T15:15:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.422+0000 7f495fe00640 1 Processor -- start 2024-05-14T15:15:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.422+0000 7f495fe00640 1 -- start start 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.424+0000 7f495fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496006f4e0 0x7f4960152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.424+0000 7f495fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 0x7f49601eab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.424+0000 7f495fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49601605a0 0x7f49601f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f495fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4960070ff0 con 0x7f496006f4e0 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f495fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f49600d2430 con 0x7f496009b410 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f495fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f49601609b0 con 0x7f49601605a0 2024-05-14T15:15:27.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 0x7f49601eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f495f400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49601605a0 0x7f49601f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 0x7f49601eab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51332/0 (socket says 172.21.15.156:51332) 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 -- 172.21.15.156:0/1200010107 learned_addr learned my addr 172.21.15.156:0/1200010107 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f495ea00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496006f4e0 0x7f4960152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 -- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49601605a0 msgr2=0x7f49601f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49601605a0 0x7f49601f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 -- 172.21.15.156:0/1200010107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496006f4e0 msgr2=0x7f4960152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496006f4e0 0x7f4960152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.425+0000 7f4957e00640 1 -- 172.21.15.156:0/1200010107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49601e7eb0 con 0x7f496009b410 2024-05-14T15:15:27.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f4957e00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 0x7f49601eab20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4948035040 tx=0x7f49480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:27.425 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948037050 con 0x7f496009b410 2024-05-14T15:15:27.425 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948038040 con 0x7f496009b410 2024-05-14T15:15:27.425 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49601e83b0 con 0x7f496009b410 2024-05-14T15:15:27.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948004450 con 0x7f496009b410 2024-05-14T15:15:27.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49601e8970 con 0x7f496009b410 2024-05-14T15:15:27.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.426+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f494803c6d0 con 0x7f496009b410 2024-05-14T15:15:27.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.427+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f494803c9c0 con 0x7f496009b410 2024-05-14T15:15:27.426 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:27.427+0000 7fd780237040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:15:27.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.427+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4960050870 con 0x7f496009b410 2024-05-14T15:15:27.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.430+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f494803cce0 con 0x7f496009b410 2024-05-14T15:15:27.483 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:27.485+0000 7fd780237040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:15:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.506+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d6d4dfb-cc36-4f09-bd95-50f8d37fb849", "id": 7} v 0) -- 0x7f4960070890 con 0x7f496009b410 2024-05-14T15:15:27.512 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.514+0000 7f4956a00640 1 -- 172.21.15.156:0/1200010107 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d6d4dfb-cc36-4f09-bd95-50f8d37fb849", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f49480038e0 con 0x7f496009b410 2024-05-14T15:15:27.512 INFO:teuthology.orchestra.run.smithi156.stdout:7 2024-05-14T15:15:27.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 msgr2=0x7f49601eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 0x7f49601eab20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4948035040 tx=0x7f49480046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 shutdown_connections 2024-05-14T15:15:27.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f496009b410 0x7f49601eab20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49601605a0 0x7f49601f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 --2- 172.21.15.156:0/1200010107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496006f4e0 0x7f4960152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 >> 172.21.15.156:0/1200010107 conn(0x7f49600b7350 msgr2=0x7f49600d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 shutdown_connections 2024-05-14T15:15:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:15:27.515+0000 7f495fe00640 1 -- 172.21.15.156:0/1200010107 wait complete. 2024-05-14T15:15:27.533 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:27.534+0000 7f442231e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:15:27.534 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-14T15:15:27.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-14T15:15:27.542 INFO:tasks.ceph.osd.0:Started 2024-05-14T15:15:27.542 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-14T15:15:27.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-14T15:15:27.549 INFO:tasks.ceph.osd.1:Started 2024-05-14T15:15:27.549 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-14T15:15:27.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-14T15:15:27.554 INFO:tasks.ceph.osd.2:Started 2024-05-14T15:15:27.554 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-14T15:15:27.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-14T15:15:27.560 INFO:tasks.ceph.osd.3:Started 2024-05-14T15:15:27.560 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-14T15:15:27.560 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-14T15:15:27.565 INFO:tasks.ceph.osd.4:Started 2024-05-14T15:15:27.565 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-14T15:15:27.565 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-14T15:15:27.569 INFO:tasks.ceph.osd.5:Started 2024-05-14T15:15:27.570 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-14T15:15:27.570 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-14T15:15:27.575 INFO:tasks.ceph.osd.6:Started 2024-05-14T15:15:27.575 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-14T15:15:27.575 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-14T15:15:27.580 INFO:tasks.ceph.osd.7:Started 2024-05-14T15:15:27.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:15:27.605 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:27.606+0000 7f442231e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:15:27.690 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:27.692+0000 7fd780237040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:15:27.832 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:27.833+0000 7f442231e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:15:27.924 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:27.926+0000 7fd780237040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:15:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.930+0000 7fe686600640 1 Processor -- start 2024-05-14T15:15:27.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.930+0000 7fe686600640 1 -- start start 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe686600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe68015cf60 0x7fe6800ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe686600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe68006de10 0x7fe6800b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe686600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6800b4950 con 0x7fe6800aeea0 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe686600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe6800af2b0 con 0x7fe68006de10 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe686600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fe680161870 con 0x7fe68015cf60 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe67fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe68006de10 0x7fe6800b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe67fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe68006de10 0x7fe6800b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53762/0 (socket says 172.21.15.2:53762) 2024-05-14T15:15:27.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe67fe00640 1 -- 172.21.15.2:0/2344534601 learned_addr learned my addr 172.21.15.2:0/2344534601 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:27.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe67f400640 1 --2- 172.21.15.2:0/2344534601 >> v2:172.21.15.156:3300/0 conn(0x7fe68015cf60 0x7fe6800ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe67fe00640 1 -- 172.21.15.2:0/2344534601 >> v2:172.21.15.156:3300/0 conn(0x7fe68015cf60 msgr2=0x7fe6800ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:27.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.932+0000 7fe67fe00640 1 --2- 172.21.15.2:0/2344534601 >> v2:172.21.15.156:3300/0 conn(0x7fe68015cf60 0x7fe6800ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.933+0000 7fe67fe00640 1 -- 172.21.15.2:0/2344534601 >> v1:172.21.15.156:6789/0 conn(0x7fe6800aeea0 legacy=0x7fe68006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.933+0000 7fe67fe00640 1 -- 172.21.15.2:0/2344534601 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe680160ab0 con 0x7fe68006de10 2024-05-14T15:15:27.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.934+0000 7fe67fe00640 1 --2- 172.21.15.2:0/2344534601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe68006de10 0x7fe6800b4f60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe6800719d0 tx=0x7fe67802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fa48588f619bfb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:27.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.934+0000 7fe67e000640 1 -- 172.21.15.2:0/2344534601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67800b2d0 con 0x7fe68006de10 2024-05-14T15:15:27.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.934+0000 7fe67e000640 1 -- 172.21.15.2:0/2344534601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67800b470 con 0x7fe68006de10 2024-05-14T15:15:27.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.934+0000 7fe67e000640 1 -- 172.21.15.2:0/2344534601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678009820 con 0x7fe68006de10 2024-05-14T15:15:27.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 -- 172.21.15.2:0/2344534601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe68006de10 msgr2=0x7fe6800b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 --2- 172.21.15.2:0/2344534601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe68006de10 0x7fe6800b4f60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe6800719d0 tx=0x7fe67802c8b0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 -- 172.21.15.2:0/2344534601 shutdown_connections 2024-05-14T15:15:27.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 --2- 172.21.15.2:0/2344534601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe68006de10 0x7fe6800b4f60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 --2- 172.21.15.2:0/2344534601 >> v2:172.21.15.156:3300/0 conn(0x7fe68015cf60 0x7fe6800ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 -- 172.21.15.2:0/2344534601 >> 172.21.15.2:0/2344534601 conn(0x7fe6800d1d10 msgr2=0x7fe6800734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:27.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 -- 172.21.15.2:0/2344534601 shutdown_connections 2024-05-14T15:15:27.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.935+0000 7fe686600640 1 -- 172.21.15.2:0/2344534601 wait complete. 2024-05-14T15:15:27.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.937+0000 7fe686600640 1 Processor -- start 2024-05-14T15:15:27.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.937+0000 7fe686600640 1 -- start start 2024-05-14T15:15:27.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe686600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 0x7fe6800d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe686600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe68015cf60 0x7fe68014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe686600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe680156b50 0x7fe680156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe686600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe680161350 con 0x7fe6800aeea0 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe686600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe680161070 con 0x7fe680156b50 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe686600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe6800af4d0 con 0x7fe68015cf60 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe67f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 0x7fe6800d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe67f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 0x7fe6800d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53772/0 (socket says 172.21.15.2:53772) 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe67f400640 1 -- 172.21.15.2:0/160627545 learned_addr learned my addr 172.21.15.2:0/160627545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe67fe00640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe680156b50 0x7fe680156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.939+0000 7fe67ea00640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe68015cf60 0x7fe68014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67f400640 1 -- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe68015cf60 msgr2=0x7fe68014b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67f400640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe68015cf60 0x7fe68014b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67f400640 1 -- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe680156b50 msgr2=0x7fe680156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:27.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67f400640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe680156b50 0x7fe680156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:27.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67f400640 1 -- 172.21.15.2:0/160627545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6801574a0 con 0x7fe6800aeea0 2024-05-14T15:15:27.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67fe00640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe680156b50 0x7fe680156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe67f400640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 0x7fe6800d05e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e870 tx=0x7fe67000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670017070 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67000c8e0 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67000ccd0 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68014b6b0 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.940+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6800ce090 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.941+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe67001a070 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.941+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe67001c450 con 0x7fe6800aeea0 2024-05-14T15:15:27.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.942+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6800ce2d0 con 0x7fe6800aeea0 2024-05-14T15:15:27.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:27.944+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe6800ce2d0 con 0x7fe6800aeea0 2024-05-14T15:15:27.984 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:27.986+0000 7fd780237040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:15:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.010+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe680050870 con 0x7fe6800aeea0 2024-05-14T15:15:28.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.011+0000 7fe677400640 1 -- 172.21.15.2:0/160627545 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe6801574a0 con 0x7fe6800aeea0 2024-05-14T15:15:28.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:28.010 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:27.508961+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.012+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 msgr2=0x7fe6800d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.012+0000 7fe686600640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 0x7fe6800d05e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e870 tx=0x7fe67000ec70 comp rx=0 tx=0).stop 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 shutdown_connections 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe680156b50 0x7fe680156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe68015cf60 0x7fe68014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 --2- 172.21.15.2:0/160627545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6800aeea0 0x7fe6800d05e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 >> 172.21.15.2:0/160627545 conn(0x7fe6800d1d10 msgr2=0x7fe680070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 shutdown_connections 2024-05-14T15:15:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:28.013+0000 7fe686600640 1 -- 172.21.15.2:0/160627545 wait complete. 2024-05-14T15:15:28.016 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:28.017+0000 7f442231e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:15:28.035 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-14T15:15:28.036 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-14T15:15:28.066 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:28.068+0000 7fd780237040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:15:28.080 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:28.080+0000 7f442231e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:15:28.121 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:28.123+0000 7fd780237040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:15:28.165 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:28.166+0000 7f442231e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:15:28.221 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:28.222+0000 7f442231e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:15:28.325 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-05-14T15:15:28.327+0000 7f84e940f640 -1 Falling back to public interface 2024-05-14T15:15:28.326 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-05-14T15:15:28.327+0000 7f89d45dc640 -1 Falling back to public interface 2024-05-14T15:15:28.331 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-05-14T15:15:28.333+0000 7f033e4b5640 -1 Falling back to public interface 2024-05-14T15:15:28.348 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-05-14T15:15:28.350+0000 7f2502588640 -1 Falling back to public interface 2024-05-14T15:15:28.384 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-05-14T15:15:28.385+0000 7f8984dc0640 -1 Falling back to public interface 2024-05-14T15:15:28.394 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-05-14T15:15:28.395+0000 7fd57202e640 -1 Falling back to public interface 2024-05-14T15:15:28.400 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-05-14T15:15:28.401+0000 7f19e322f640 -1 Falling back to public interface 2024-05-14T15:15:28.410 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-05-14T15:15:28.413+0000 7f76dc024640 -1 Falling back to public interface 2024-05-14T15:15:28.671 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:28.674+0000 7fd780237040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:15:28.796 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:28.797+0000 7f442231e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:15:28.804 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:28.806+0000 7fd780237040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:15:28.842 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T15:15:28.942 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-05-14T15:15:28.943+0000 7f442231e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:15:29.072 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.073+0000 7fa42fe00640 1 Processor -- start 2024-05-14T15:15:29.073 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.073+0000 7fa42fe00640 1 -- start start 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.075+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 0x7fa430160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4300b9130 0x7fa43006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300d54a0 con 0x7fa43006d960 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42fe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fa43006c6f0 con 0x7fa4300b9130 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa43006c940 con 0x7fa4300d41a0 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa43006d960 0x7fa4300d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58892/0 (socket says 172.21.15.2:58892) 2024-05-14T15:15:29.075 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42f400640 1 -- 172.21.15.2:0/2392006119 learned_addr learned my addr 172.21.15.2:0/2392006119 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:29.077 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42e000640 1 --2- 172.21.15.2:0/2392006119 >> v2:172.21.15.156:3300/0 conn(0x7fa4300b9130 0x7fa43006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.077 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.076+0000 7fa42ea00640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 0x7fa430160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.077 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054962318 0 0) 0x7fa4300d54a0 con 0x7fa43006d960 2024-05-14T15:15:29.077 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa414003520 con 0x7fa43006d960 2024-05-14T15:15:29.077 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 879750981 0 0) 0x7fa414003520 con 0x7fa43006d960 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 msgr2=0x7fa430160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 0x7fa430160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 >> v2:172.21.15.156:3300/0 conn(0x7fa4300b9130 msgr2=0x7fa43006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 --2- 172.21.15.2:0/2392006119 >> v2:172.21.15.156:3300/0 conn(0x7fa4300b9130 0x7fa43006d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43006cc20 con 0x7fa43006d960 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fa428001a70 con 0x7fa43006d960 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 >> v1:172.21.15.2:6789/0 conn(0x7fa43006d960 legacy=0x7fa4300d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 0x7fa414003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa414004020 0x7fa414004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa414004d40 0x7fa414005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa43006c6f0 con 0x7fa414004d40 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa43006c940 con 0x7fa414004020 2024-05-14T15:15:29.078 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa41400bb20 con 0x7fa4300d41a0 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.077+0000 7fa42f400640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa414004d40 0x7fa414005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42e000640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa414004020 0x7fa414004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42ea00640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 0x7fa414003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42f400640 1 -- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 msgr2=0x7fa414003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42f400640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300d41a0 0x7fa414003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42f400640 1 -- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa414004020 msgr2=0x7fa414004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42f400640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa414004020 0x7fa414004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42f400640 1 -- 172.21.15.2:0/2392006119 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa414003520 con 0x7fa414004d40 2024-05-14T15:15:29.079 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.078+0000 7fa42e000640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa414004020 0x7fa414004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:29.080 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.079+0000 7fa42f400640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa414004d40 0x7fa414005150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa4300d3f50 tx=0x7fa414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f48dfb3d5c8ba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:29.080 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.079+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42800a410 con 0x7fa414004d40 2024-05-14T15:15:29.080 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.079+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42802f070 con 0x7fa414004d40 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.079+0000 7fa42d600640 1 -- 172.21.15.2:0/2392006119 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42802bb80 con 0x7fa414004d40 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42fe00640 1 -- 172.21.15.2:0/2392006119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa414004d40 msgr2=0x7fa414005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42fe00640 1 --2- 172.21.15.2:0/2392006119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa414004d40 0x7fa414005150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa4300d3f50 tx=0x7fa414005830 comp rx=0 tx=0).stop 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42f400640 1 -- 172.21.15.2:0/2392006119 reap_dead start 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42fe00640 1 -- 172.21.15.2:0/2392006119 shutdown_connections 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42fe00640 1 -- 172.21.15.2:0/2392006119 >> 172.21.15.2:0/2392006119 conn(0x7fa4300b7710 msgr2=0x7fa4300b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42fe00640 1 -- 172.21.15.2:0/2392006119 shutdown_connections 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.080+0000 7fa42fe00640 1 -- 172.21.15.2:0/2392006119 wait complete. 2024-05-14T15:15:29.081 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.082+0000 7fa42fe00640 1 Processor -- start 2024-05-14T15:15:29.082 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.082+0000 7fa42fe00640 1 -- start start 2024-05-14T15:15:29.084 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4301f5ed0 0x7fa4300cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.084 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300ce3b0 0x7fa43015a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.084 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 0x7fa43015cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:29.084 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300d5200 con 0x7fa43015ae10 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300d5080 con 0x7fa4301f5ed0 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa4300b9540 con 0x7fa4300ce3b0 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 0x7fa43015cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 0x7fa43015cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53786/0 (socket says 172.21.15.2:53786) 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42f400640 1 -- 172.21.15.2:0/4139977920 learned_addr learned my addr 172.21.15.2:0/4139977920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42ea00640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4301f5ed0 0x7fa4300cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.084+0000 7fa42e000640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300ce3b0 0x7fa43015a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42f400640 1 -- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300ce3b0 msgr2=0x7fa43015a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42f400640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300ce3b0 0x7fa43015a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42f400640 1 -- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4301f5ed0 msgr2=0x7fa4300cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42f400640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4301f5ed0 0x7fa4300cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42f400640 1 -- 172.21.15.2:0/4139977920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43015b220 con 0x7fa43015ae10 2024-05-14T15:15:29.085 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42ea00640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4301f5ed0 0x7fa4300cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:29.086 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42f400640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 0x7fa43015cc20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa42800a880 tx=0x7fa4300d2110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:29.086 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42800a410 con 0x7fa43015ae10 2024-05-14T15:15:29.086 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42802bdf0 con 0x7fa43015ae10 2024-05-14T15:15:29.086 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428001f60 con 0x7fa43015ae10 2024-05-14T15:15:29.086 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4300ce930 con 0x7fa43015ae10 2024-05-14T15:15:29.086 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.085+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4300ceef0 con 0x7fa43015ae10 2024-05-14T15:15:29.087 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.086+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4300769f0 con 0x7fa43015ae10 2024-05-14T15:15:29.087 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.087+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 2) ==== 49122+0+0 (secure 0 0 0) 0x7fa4280346b0 con 0x7fa43015ae10 2024-05-14T15:15:29.087 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.087+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa428070720 con 0x7fa43015ae10 2024-05-14T15:15:29.088 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.090+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa43015b220 con 0x7fa43015ae10 2024-05-14T15:15:29.154 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.154+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4300cfd40 con 0x7fa43015ae10 2024-05-14T15:15:29.154 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.155+0000 7fa427400640 1 -- 172.21.15.2:0/4139977920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa428034b80 con 0x7fa43015ae10 2024-05-14T15:15:29.154 INFO:teuthology.misc.health.smithi002.stdout: 2024-05-14T15:15:29.155 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:27.508961+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.156+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 msgr2=0x7fa43015cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.156+0000 7fa42fe00640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 0x7fa43015cc20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa42800a880 tx=0x7fa4300d2110 comp rx=0 tx=0).stop 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.156+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 shutdown_connections 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.157+0000 7fa42fe00640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43015ae10 0x7fa43015cc20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.157+0000 7fa42fe00640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4300ce3b0 0x7fa43015a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.157+0000 7fa42fe00640 1 --2- 172.21.15.2:0/4139977920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4301f5ed0 0x7fa4300cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.157+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 >> 172.21.15.2:0/4139977920 conn(0x7fa4300b7710 msgr2=0x7fa4300d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.157+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 shutdown_connections 2024-05-14T15:15:29.156 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:29.157+0000 7fa42fe00640 1 -- 172.21.15.2:0/4139977920 wait complete. 2024-05-14T15:15:29.173 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-14T15:15:29.841 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:29.843+0000 7fd71ee00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-14T15:15:29.842 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-05-14T15:15:29.844+0000 7fd71ee00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-14T15:15:31.813 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-05-14T15:15:31.802+0000 7f76dc024640 -1 osd.4 0 log_to_monitors true 2024-05-14T15:15:31.941 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-05-14T15:15:31.943+0000 7f84e940f640 -1 osd.6 0 log_to_monitors true 2024-05-14T15:15:31.999 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-05-14T15:15:32.001+0000 7f2502588640 -1 osd.5 0 log_to_monitors true 2024-05-14T15:15:32.019 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-05-14T15:15:32.021+0000 7f8984dc0640 -1 osd.0 0 log_to_monitors true 2024-05-14T15:15:32.157 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-05-14T15:15:32.159+0000 7f89d45dc640 -1 osd.3 0 log_to_monitors true 2024-05-14T15:15:32.205 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-05-14T15:15:32.208+0000 7f033e4b5640 -1 osd.7 0 log_to_monitors true 2024-05-14T15:15:32.265 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-05-14T15:15:32.267+0000 7fd57202e640 -1 osd.2 0 log_to_monitors true 2024-05-14T15:15:32.314 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-05-14T15:15:32.316+0000 7f19e322f640 -1 osd.1 0 log_to_monitors true 2024-05-14T15:15:33.889 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-05-14T15:15:33.891+0000 7f76d6a00640 -1 osd.4 0 waiting for initial osdmap 2024-05-14T15:15:33.912 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-05-14T15:15:33.914+0000 7f76cca00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.315 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-05-14T15:15:35.317+0000 7f24fd400640 -1 osd.5 0 waiting for initial osdmap 2024-05-14T15:15:35.326 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-05-14T15:15:35.328+0000 7f24f3400640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.339 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-05-14T15:15:35.341+0000 7f0339400640 -1 osd.7 0 waiting for initial osdmap 2024-05-14T15:15:35.339 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-05-14T15:15:35.341+0000 7f84e4800640 -1 osd.6 0 waiting for initial osdmap 2024-05-14T15:15:35.346 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-05-14T15:15:35.348+0000 7f032f400640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.351 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-05-14T15:15:35.354+0000 7f84d9e00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.648 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-05-14T15:15:35.649+0000 7f897fc00640 -1 osd.0 0 waiting for initial osdmap 2024-05-14T15:15:35.663 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-05-14T15:15:35.665+0000 7f8975c00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.703 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-05-14T15:15:35.705+0000 7f89cf400640 -1 osd.3 0 waiting for initial osdmap 2024-05-14T15:15:35.705 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-05-14T15:15:35.707+0000 7fd56c400640 -1 osd.2 0 waiting for initial osdmap 2024-05-14T15:15:35.707 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-05-14T15:15:35.710+0000 7f19de000640 -1 osd.1 0 waiting for initial osdmap 2024-05-14T15:15:35.713 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-05-14T15:15:35.715+0000 7f89c5400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.713 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-05-14T15:15:35.715+0000 7fd562400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.714 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-05-14T15:15:35.715+0000 7f19d3600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:15:35.980 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T15:15:36.239 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.241+0000 7fa74e200640 1 Processor -- start 2024-05-14T15:15:36.239 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.241+0000 7fa74e200640 1 -- start start 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.243+0000 7fa74e200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa748149280 0x7fa7480b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.243+0000 7fa74e200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa748143530 con 0x7fa7480b0370 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.243+0000 7fa74e200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7480ae9d0 con 0x7fa748143120 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.243+0000 7fa74e200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa74806fc20 con 0x7fa748149280 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.244+0000 7fa74ce00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa748149280 0x7fa7480b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.244+0000 7fa74d800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa7480b0370 0x7fa7480b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40538/0 (socket says 172.21.15.2:40538) 2024-05-14T15:15:36.242 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.244+0000 7fa74d800640 1 -- 172.21.15.2:0/64357831 learned_addr learned my addr 172.21.15.2:0/64357831 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:36.243 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.244+0000 7fa74ce00640 1 -- 172.21.15.2:0/64357831 >> v1:172.21.15.156:6789/0 conn(0x7fa748143120 legacy=0x7fa748070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.243 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.244+0000 7fa74ce00640 1 -- 172.21.15.2:0/64357831 >> v1:172.21.15.2:6789/0 conn(0x7fa7480b0370 legacy=0x7fa7480b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.243 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.244+0000 7fa74ce00640 1 -- 172.21.15.2:0/64357831 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7480aecb0 con 0x7fa748149280 2024-05-14T15:15:36.244 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.245+0000 7fa74ce00640 1 --2- 172.21.15.2:0/64357831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748149280 0x7fa7480b47e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0097a0 tx=0x7fa73c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698dedfca3d0b501 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:36.244 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.246+0000 7fa747400640 1 -- 172.21.15.2:0/64357831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c037070 con 0x7fa748149280 2024-05-14T15:15:36.244 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.246+0000 7fa747400640 1 -- 172.21.15.2:0/64357831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c032440 con 0x7fa748149280 2024-05-14T15:15:36.244 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.246+0000 7fa747400640 1 -- 172.21.15.2:0/64357831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c02ae60 con 0x7fa748149280 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.246+0000 7fa74e200640 1 -- 172.21.15.2:0/64357831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748149280 msgr2=0x7fa7480b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.246+0000 7fa74e200640 1 --2- 172.21.15.2:0/64357831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748149280 0x7fa7480b47e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0097a0 tx=0x7fa73c02a110 comp rx=0 tx=0).stop 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.247+0000 7fa74e200640 1 -- 172.21.15.2:0/64357831 shutdown_connections 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.247+0000 7fa74e200640 1 --2- 172.21.15.2:0/64357831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748149280 0x7fa7480b47e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.247+0000 7fa74e200640 1 -- 172.21.15.2:0/64357831 >> 172.21.15.2:0/64357831 conn(0x7fa748074390 msgr2=0x7fa74806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.247+0000 7fa74e200640 1 -- 172.21.15.2:0/64357831 shutdown_connections 2024-05-14T15:15:36.245 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.247+0000 7fa74e200640 1 -- 172.21.15.2:0/64357831 wait complete. 2024-05-14T15:15:36.248 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.250+0000 7fa74e200640 1 Processor -- start 2024-05-14T15:15:36.248 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.250+0000 7fa74e200640 1 -- start start 2024-05-14T15:15:36.251 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74e200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7480b0370 0x7fa74813b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.251 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74e200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 0x7fa7480cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.251 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74e200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748149280 0x7fa7480cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74e200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7480b4df0 con 0x7fa748143120 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74e200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa748070150 con 0x7fa748149280 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74e200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa7480b4f70 con 0x7fa7480b0370 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa747e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 0x7fa7480cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa747e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 0x7fa7480cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33280/0 (socket says 172.21.15.2:33280) 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa747e00640 1 -- 172.21.15.2:0/3973922552 learned_addr learned my addr 172.21.15.2:0/3973922552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74ce00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7480b0370 0x7fa74813b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa74d800640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748149280 0x7fa7480cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.252+0000 7fa747e00640 1 -- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7480b0370 msgr2=0x7fa74813b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa747e00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7480b0370 0x7fa74813b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa747e00640 1 -- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748149280 msgr2=0x7fa7480cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa747e00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748149280 0x7fa7480cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.252 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa747e00640 1 -- 172.21.15.2:0/3973922552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74813dc90 con 0x7fa748143120 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa74ce00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7480b0370 0x7fa74813b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa74d800640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748149280 0x7fa7480cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa747e00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 0x7fa7480cf7c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c3a0 tx=0x7fa73400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734017070 con 0x7fa748143120 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7340052d0 con 0x7fa748143120 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734003830 con 0x7fa748143120 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7480cece0 con 0x7fa748143120 2024-05-14T15:15:36.253 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.253+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74813b8c0 con 0x7fa748143120 2024-05-14T15:15:36.254 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.255+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74813da00 con 0x7fa748143120 2024-05-14T15:15:36.254 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.256+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fa73401a070 con 0x7fa748143120 2024-05-14T15:15:36.255 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.257+0000 7fa744c00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa728076270 0x7fa728078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.257 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.257+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7fa734095bd0 con 0x7fa748143120 2024-05-14T15:15:36.257 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.257+0000 7fa74ce00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa728076270 0x7fa728078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.258 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.259+0000 7fa74ce00640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa728076270 0x7fa728078780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa73c034000 tx=0x7fa73c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:36.260 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.263+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa7340601f0 con 0x7fa748143120 2024-05-14T15:15:36.477 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.479+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7480769f0 con 0x7fa748143120 2024-05-14T15:15:36.479 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.481+0000 7fa744c00640 1 -- 172.21.15.2:0/3973922552 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10860 (secure 0 0 0) 0x7fa7340681e0 con 0x7fa748143120 2024-05-14T15:15:36.479 INFO:teuthology.misc.health.smithi002.stdout: 2024-05-14T15:15:36.479 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":15,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:36.323073+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:15:36.481 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa728076270 msgr2=0x7fa728078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.481 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa728076270 0x7fa728078780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa73c034000 tx=0x7fa73c02e000 comp rx=0 tx=0).stop 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 msgr2=0x7fa7480cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 0x7fa7480cf7c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c3a0 tx=0x7fa73400c860 comp rx=0 tx=0).stop 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 shutdown_connections 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa728076270 0x7fa728078780 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748149280 0x7fa7480cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa748143120 0x7fa7480cf7c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 --2- 172.21.15.2:0/3973922552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7480b0370 0x7fa74813b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.482 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.483+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 >> 172.21.15.2:0/3973922552 conn(0x7fa748074390 msgr2=0x7fa7480b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:36.483 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.484+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 shutdown_connections 2024-05-14T15:15:36.483 INFO:teuthology.misc.health.smithi002.stderr:2024-05-14T15:15:36.484+0000 7fa74e200640 1 -- 172.21.15.2:0/3973922552 wait complete. 2024-05-14T15:15:36.502 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-14T15:15:36.503 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-14T15:15:36.503 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T15:15:36.503 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-14T15:15:36.510 INFO:tasks.ceph.mds.a:Started 2024-05-14T15:15:36.510 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T15:15:36.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-14T15:15:36.517 INFO:tasks.ceph.mds.c:Started 2024-05-14T15:15:36.517 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T15:15:36.517 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-14T15:15:36.525 INFO:tasks.ceph.mds.b:Started 2024-05-14T15:15:36.525 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T15:15:36.525 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-14T15:15:36.532 INFO:tasks.ceph.mds.d:Started 2024-05-14T15:15:36.532 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-14T15:15:36.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:15:36.726 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-05-14T15:15:36.727 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-05-14T15:15:36.755 INFO:tasks.ceph.mds.d.smithi156.stdout:starting mds.d at 2024-05-14T15:15:36.759 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2024-05-14T15:15:36.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.800+0000 7f43dde00640 1 Processor -- start 2024-05-14T15:15:36.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.800+0000 7f43dde00640 1 -- start start 2024-05-14T15:15:36.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43dde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43d806de10 0x7f43d80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43dde00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d80b4e00 con 0x7f43d80706e0 2024-05-14T15:15:36.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43dde00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d80b50e0 con 0x7f43d8160070 2024-05-14T15:15:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43dde00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f43d80b4bd0 con 0x7f43d806de10 2024-05-14T15:15:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43d7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43d806de10 0x7f43d80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43d7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43d806de10 0x7f43d80b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33326/0 (socket says 172.21.15.2:33326) 2024-05-14T15:15:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43d7400640 1 -- 172.21.15.2:0/3203699377 learned_addr learned my addr 172.21.15.2:0/3203699377 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.802+0000 7f43d6a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f43d80706e0 0x7f43d8164320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40548/0 (socket says 172.21.15.2:40548) 2024-05-14T15:15:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.803+0000 7f43d7400640 1 -- 172.21.15.2:0/3203699377 >> v1:172.21.15.156:6789/0 conn(0x7f43d8160070 legacy=0x7f43d806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.803+0000 7f43d7400640 1 -- 172.21.15.2:0/3203699377 >> v1:172.21.15.2:6789/0 conn(0x7f43d80706e0 legacy=0x7f43d8164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.803+0000 7f43d7400640 1 -- 172.21.15.2:0/3203699377 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d80b53c0 con 0x7f43d806de10 2024-05-14T15:15:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.804+0000 7f43d7400640 1 --2- 172.21.15.2:0/3203699377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d806de10 0x7f43d80b4690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009e50 tx=0x7f43d002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e227a833aaad034 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.804+0000 7f43d6000640 1 -- 172.21.15.2:0/3203699377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0036070 con 0x7f43d806de10 2024-05-14T15:15:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.804+0000 7f43d6000640 1 -- 172.21.15.2:0/3203699377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d0031600 con 0x7f43d806de10 2024-05-14T15:15:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.804+0000 7f43d6000640 1 -- 172.21.15.2:0/3203699377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00319f0 con 0x7f43d806de10 2024-05-14T15:15:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 -- 172.21.15.2:0/3203699377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d806de10 msgr2=0x7f43d80b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 --2- 172.21.15.2:0/3203699377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d806de10 0x7f43d80b4690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009e50 tx=0x7f43d002a7c0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 -- 172.21.15.2:0/3203699377 shutdown_connections 2024-05-14T15:15:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 --2- 172.21.15.2:0/3203699377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d806de10 0x7f43d80b4690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 -- 172.21.15.2:0/3203699377 >> 172.21.15.2:0/3203699377 conn(0x7f43d80d1d10 msgr2=0x7f43d80734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 -- 172.21.15.2:0/3203699377 shutdown_connections 2024-05-14T15:15:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.805+0000 7f43dde00640 1 -- 172.21.15.2:0/3203699377 wait complete. 2024-05-14T15:15:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.807+0000 7f43dde00640 1 Processor -- start 2024-05-14T15:15:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.807+0000 7f43dde00640 1 -- start start 2024-05-14T15:15:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43dde00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d80706e0 0x7f43d815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43dde00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d8160070 0x7f43d814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43dde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 0x7f43d806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43dde00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8164a30 con 0x7f43d80cd8f0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43dde00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8160480 con 0x7f43d80706e0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43dde00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f43d8164bb0 con 0x7f43d8160070 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43d7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 0x7f43d806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43d7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 0x7f43d806d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33336/0 (socket says 172.21.15.2:33336) 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43d7400640 1 -- 172.21.15.2:0/1947442025 learned_addr learned my addr 172.21.15.2:0/1947442025 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43d6a00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d80706e0 0x7f43d815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.809+0000 7f43cfe00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d8160070 0x7f43d814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43d7400640 1 -- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d8160070 msgr2=0x7f43d814b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43d7400640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d8160070 0x7f43d814b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43d7400640 1 -- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d80706e0 msgr2=0x7f43d815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43d7400640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d80706e0 0x7f43d815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43d7400640 1 -- 172.21.15.2:0/1947442025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d815e5a0 con 0x7f43d80cd8f0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43d7400640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 0x7f43d806d290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43d0034040 tx=0x7f43d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0036050 con 0x7f43d80cd8f0 2024-05-14T15:15:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d0042070 con 0x7f43d80cd8f0 2024-05-14T15:15:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d815e880 con 0x7f43d80cd8f0 2024-05-14T15:15:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0009510 con 0x7f43d80cd8f0 2024-05-14T15:15:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.810+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d815ee40 con 0x7f43d80cd8f0 2024-05-14T15:15:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.811+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d8050870 con 0x7f43d80cd8f0 2024-05-14T15:15:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.813+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f43d0004470 con 0x7f43d80cd8f0 2024-05-14T15:15:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.814+0000 7f43cf400640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43b4076270 0x7f43b4078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.814+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7f43d00b7e00 con 0x7f43d80cd8f0 2024-05-14T15:15:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.814+0000 7f43d6a00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43b4076270 0x7f43b4078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.815+0000 7f43d6a00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43b4076270 0x7f43b4078780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43c8000f60 tx=0x7f43c8007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:36.819+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43d0081630 con 0x7f43d80cd8f0 2024-05-14T15:15:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.077+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43d80b5980 con 0x7f43d80cd8f0 2024-05-14T15:15:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.078+0000 7f43cf400640 1 -- 172.21.15.2:0/1947442025 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f43d0085930 con 0x7f43d80cd8f0 2024-05-14T15:15:37.076 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:37.076 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T15:15:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43b4076270 msgr2=0x7f43b4078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43b4076270 0x7f43b4078780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43c8000f60 tx=0x7f43c8007e20 comp rx=0 tx=0).stop 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 msgr2=0x7f43d806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 0x7f43d806d290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43d0034040 tx=0x7f43d0004a40 comp rx=0 tx=0).stop 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 shutdown_connections 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43b4076270 0x7f43b4078780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43d80cd8f0 0x7f43d806d290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d8160070 0x7f43d814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 --2- 172.21.15.2:0/1947442025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d80706e0 0x7f43d815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 >> 172.21.15.2:0/1947442025 conn(0x7f43d80d1d10 msgr2=0x7f43d8159640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 shutdown_connections 2024-05-14T15:15:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:37.081+0000 7f43dde00640 1 -- 172.21.15.2:0/1947442025 wait complete. 2024-05-14T15:15:39.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:15:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.385+0000 7fcae3e00640 1 Processor -- start 2024-05-14T15:15:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.385+0000 7fcae3e00640 1 -- start start 2024-05-14T15:15:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.387+0000 7fcae3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 0x7fcae415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.387+0000 7fcae3e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae40b5ab0 con 0x7fcae406d700 2024-05-14T15:15:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.387+0000 7fcae3e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae40b0d10 con 0x7fcae40b56a0 2024-05-14T15:15:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.387+0000 7fcae3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcae415cfc0 con 0x7fcae40b64e0 2024-05-14T15:15:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.387+0000 7fcae3400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcae406d700 0x7fcae406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40564/0 (socket says 172.21.15.2:40564) 2024-05-14T15:15:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.387+0000 7fcae3400640 1 -- 172.21.15.2:0/4065652359 learned_addr learned my addr 172.21.15.2:0/4065652359 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae2000640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 0x7fcae415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325931352 0 0) 0x7fcadc001490 con 0x7fcae406d700 2024-05-14T15:15:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcac8005730 con 0x7fcae406d700 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2538860938 0 0) 0x7fcac8005730 con 0x7fcae406d700 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 msgr2=0x7fcae415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 0x7fcae415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 >> v1:172.21.15.156:6789/0 conn(0x7fcae40b56a0 legacy=0x7fcae40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae40b0ff0 con 0x7fcae406d700 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fcadc001c40 con 0x7fcae406d700 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 >> v1:172.21.15.2:6789/0 conn(0x7fcae406d700 legacy=0x7fcae406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8005c90 0x7fcac8006100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac8006a10 0x7fcac8006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 0x7fcac800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.388+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcae415cfc0 con 0x7fcac8005c90 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80076f0 con 0x7fcac8006a10 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcac800e110 con 0x7fcae40b64e0 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2a00640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8005c90 0x7fcac8006100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae3400640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 0x7fcac800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2a00640 1 -- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 msgr2=0x7fcac800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2a00640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcae40b64e0 0x7fcac800dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2a00640 1 -- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac8006a10 msgr2=0x7fcac8006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2000640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac8006a10 0x7fcac8006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2a00640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac8006a10 0x7fcac8006e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.389+0000 7fcae2a00640 1 -- 172.21.15.2:0/4065652359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8005730 con 0x7fcac8005c90 2024-05-14T15:15:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.390+0000 7fcae2a00640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8005c90 0x7fcac8006100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcad4001790 tx=0x7fcac8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2f8792161debf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad40013b0 con 0x7fcac8005c90 2024-05-14T15:15:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad40052d0 con 0x7fcac8005c90 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae1600640 1 -- 172.21.15.2:0/4065652359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad402aae0 con 0x7fcac8005c90 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae3e00640 1 -- 172.21.15.2:0/4065652359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8005c90 msgr2=0x7fcac8006100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae3e00640 1 --2- 172.21.15.2:0/4065652359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcac8005c90 0x7fcac8006100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcad4001790 tx=0x7fcac8007a40 comp rx=0 tx=0).stop 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae3400640 1 -- 172.21.15.2:0/4065652359 reap_dead start 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae3e00640 1 -- 172.21.15.2:0/4065652359 shutdown_connections 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.391+0000 7fcae3e00640 1 -- 172.21.15.2:0/4065652359 >> 172.21.15.2:0/4065652359 conn(0x7fcae40732e0 msgr2=0x7fcae40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.392+0000 7fcae3e00640 1 -- 172.21.15.2:0/4065652359 shutdown_connections 2024-05-14T15:15:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.392+0000 7fcae3e00640 1 -- 172.21.15.2:0/4065652359 wait complete. 2024-05-14T15:15:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.394+0000 7fcae3e00640 1 Processor -- start 2024-05-14T15:15:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.394+0000 7fcae3e00640 1 -- start start 2024-05-14T15:15:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcac8005c90 0x7fcae41f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 0x7fcae40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcae40cf7c0 0x7fcae4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcae40b68f0 con 0x7fcae415f2e0 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae3e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcae40b5180 con 0x7fcae40cf7c0 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcae415ca80 con 0x7fcac8005c90 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 0x7fcae40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 0x7fcae40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33350/0 (socket says 172.21.15.2:33350) 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 -- 172.21.15.2:0/2981514624 learned_addr learned my addr 172.21.15.2:0/2981514624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 -- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcac8005c90 msgr2=0x7fcae41f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcac8005c90 0x7fcae41f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 -- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcae40cf7c0 msgr2=0x7fcae4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.396+0000 7fcae2000640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcae40cf7c0 0x7fcae4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcae2000640 1 -- 172.21.15.2:0/2981514624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae41552c0 con 0x7fcae415f2e0 2024-05-14T15:15:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcae2000640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 0x7fcae40cf280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcacc010860 tx=0x7fcacc010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00f040 con 0x7fcae415f2e0 2024-05-14T15:15:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcacc00eb60 con 0x7fcae415f2e0 2024-05-14T15:15:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc01c400 con 0x7fcae415f2e0 2024-05-14T15:15:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae41555a0 con 0x7fcae415f2e0 2024-05-14T15:15:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.397+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae4155b60 con 0x7fcae415f2e0 2024-05-14T15:15:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.398+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae415f830 con 0x7fcae415f2e0 2024-05-14T15:15:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.400+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fcacc005990 con 0x7fcae415f2e0 2024-05-14T15:15:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.401+0000 7fcadaa00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcac0076240 0x7fcac0078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.401+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fcacc0979c0 con 0x7fcae415f2e0 2024-05-14T15:15:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.402+0000 7fcae2a00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcac0076240 0x7fcac0078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.403+0000 7fcae2a00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcac0076240 0x7fcac0078750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcad4032000 tx=0x7fcad402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:39.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.406+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcacc018030 con 0x7fcae415f2e0 2024-05-14T15:15:39.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.660+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcae40d0510 con 0x7fcae415f2e0 2024-05-14T15:15:39.663 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:39.664 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.661+0000 7fcadaa00640 1 -- 172.21.15.2:0/2981514624 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3861 (secure 0 0 0) 0x7fcacc0617c0 con 0x7fcae415f2e0 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcac0076240 msgr2=0x7fcac0078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcac0076240 0x7fcac0078750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcad4032000 tx=0x7fcad402c000 comp rx=0 tx=0).stop 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 msgr2=0x7fcae40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 0x7fcae40cf280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcacc010860 tx=0x7fcacc010d20 comp rx=0 tx=0).stop 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 shutdown_connections 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcac0076240 0x7fcac0078750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcae40cf7c0 0x7fcae4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcae415f2e0 0x7fcae40cf280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 --2- 172.21.15.2:0/2981514624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcac8005c90 0x7fcae41f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 >> 172.21.15.2:0/2981514624 conn(0x7fcae40732e0 msgr2=0x7fcae406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 shutdown_connections 2024-05-14T15:15:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:39.665+0000 7fcae3e00640 1 -- 172.21.15.2:0/2981514624 wait complete. 2024-05-14T15:15:39.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T15:15:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.000+0000 7f6a34c00640 1 Processor -- start 2024-05-14T15:15:39.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.000+0000 7f6a34c00640 1 -- start start 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.002+0000 7f6a34c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300b3290 0x7f6a300b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.002+0000 7f6a34c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a300af430 0x7f6a300af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.002+0000 7f6a34c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a300b2610 con 0x7f6a3006cde0 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.002+0000 7f6a34c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6a300aefc0 con 0x7f6a300af430 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.002+0000 7f6a34c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6a300b7a10 con 0x7f6a300b3290 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a300af430 0x7f6a300af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2ea00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6a3006cde0 0x7f6a3006d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49846/0 (socket says 172.21.15.2:49846) 2024-05-14T15:15:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2ea00640 1 -- 172.21.15.2:0/811901468 learned_addr learned my addr 172.21.15.2:0/811901468 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2e000640 1 -- 172.21.15.2:0/811901468 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183391377 0 0) 0x7f6a300b2610 con 0x7f6a3006cde0 2024-05-14T15:15:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2e000640 1 -- 172.21.15.2:0/811901468 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a14003520 con 0x7f6a3006cde0 2024-05-14T15:15:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2fe00640 1 -- 172.21.15.2:0/811901468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300b3290 msgr2=0x7f6a300b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2fe00640 1 --2- 172.21.15.2:0/811901468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300b3290 0x7f6a300b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2fe00640 1 -- 172.21.15.2:0/811901468 >> v1:172.21.15.2:6789/0 conn(0x7f6a3006cde0 legacy=0x7f6a3006d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.003+0000 7f6a2fe00640 1 -- 172.21.15.2:0/811901468 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a300b7450 con 0x7f6a300af430 2024-05-14T15:15:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.005+0000 7f6a2fe00640 1 --2- 172.21.15.2:0/811901468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a300af430 0x7f6a300af840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc61a68e6c78e5b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.005+0000 7f6a2e000640 1 -- 172.21.15.2:0/811901468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28007740 con 0x7f6a300af430 2024-05-14T15:15:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.005+0000 7f6a2e000640 1 -- 172.21.15.2:0/811901468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a280078e0 con 0x7f6a300af430 2024-05-14T15:15:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.005+0000 7f6a2e000640 1 -- 172.21.15.2:0/811901468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28007cb0 con 0x7f6a300af430 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 -- 172.21.15.2:0/811901468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a300af430 msgr2=0x7f6a300af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 --2- 172.21.15.2:0/811901468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a300af430 0x7f6a300af840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2802a660 comp rx=0 tx=0).stop 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 -- 172.21.15.2:0/811901468 shutdown_connections 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 --2- 172.21.15.2:0/811901468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a300af430 0x7f6a300af840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 --2- 172.21.15.2:0/811901468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300b3290 0x7f6a300b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 -- 172.21.15.2:0/811901468 >> 172.21.15.2:0/811901468 conn(0x7f6a30073d50 msgr2=0x7f6a3009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 -- 172.21.15.2:0/811901468 shutdown_connections 2024-05-14T15:15:40.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.006+0000 7f6a34c00640 1 -- 172.21.15.2:0/811901468 wait complete. 2024-05-14T15:15:40.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.008+0000 7f6a34c00640 1 Processor -- start 2024-05-14T15:15:40.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.008+0000 7f6a34c00640 1 -- start start 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a34c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 0x7f6a3014f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a34c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300af430 0x7f6a300cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a34c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a300b3290 0x7f6a30158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a34c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b2360 con 0x7f6a3006cde0 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a34c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b21e0 con 0x7f6a300b3290 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a34c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6a301601f0 con 0x7f6a300af430 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a2f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 0x7f6a3014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a2f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 0x7f6a3014f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40752/0 (socket says 172.21.15.2:40752) 2024-05-14T15:15:40.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a2f400640 1 -- 172.21.15.2:0/1113067753 learned_addr learned my addr 172.21.15.2:0/1113067753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.010+0000 7f6a2fe00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a300b3290 0x7f6a30158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2ea00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300af430 0x7f6a300cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2f400640 1 -- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300af430 msgr2=0x7f6a300cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2f400640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300af430 0x7f6a300cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2f400640 1 -- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a300b3290 msgr2=0x7f6a30158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2f400640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a300b3290 0x7f6a30158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2f400640 1 -- 172.21.15.2:0/1113067753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3014fe50 con 0x7f6a3006cde0 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2fe00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a300b3290 0x7f6a30158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a2f400640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 0x7f6a3014f910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000b410 tx=0x7f6a2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20015020 con 0x7f6a3006cde0 2024-05-14T15:15:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.011+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a20011830 con 0x7f6a3006cde0 2024-05-14T15:15:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.012+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a300cbf20 con 0x7f6a3006cde0 2024-05-14T15:15:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.012+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20011c20 con 0x7f6a3006cde0 2024-05-14T15:15:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.012+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a300cccb0 con 0x7f6a3006cde0 2024-05-14T15:15:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.013+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a30050870 con 0x7f6a3006cde0 2024-05-14T15:15:40.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.015+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a20018020 con 0x7f6a3006cde0 2024-05-14T15:15:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.017+0000 7f6a27400640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a0c076300 0x7f6a0c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.017+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6a200977a0 con 0x7f6a3006cde0 2024-05-14T15:15:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.018+0000 7f6a2ea00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a0c076300 0x7f6a0c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.019+0000 7f6a2ea00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a0c076300 0x7f6a0c078810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a18007a60 tx=0x7f6a18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.022+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a2001f020 con 0x7f6a3006cde0 2024-05-14T15:15:40.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.240+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6a300b6440 con 0x7f6a3006cde0 2024-05-14T15:15:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.241+0000 7f6a27400640 1 -- 172.21.15.2:0/1113067753 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f6a3014fe50 con 0x7f6a3006cde0 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:15:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-05-14T15:15:40.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a0c076300 msgr2=0x7f6a0c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a0c076300 0x7f6a0c078810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a18007a60 tx=0x7f6a18009040 comp rx=0 tx=0).stop 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 msgr2=0x7f6a3014f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 0x7f6a3014f910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000b410 tx=0x7f6a2000b8d0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 shutdown_connections 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a0c076300 0x7f6a0c078810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a300b3290 0x7f6a30158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a300af430 0x7f6a300cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 --2- 172.21.15.2:0/1113067753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a3006cde0 0x7f6a3014f910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 >> 172.21.15.2:0/1113067753 conn(0x7f6a30073d50 msgr2=0x7f6a30068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 shutdown_connections 2024-05-14T15:15:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.244+0000 7f6a34c00640 1 -- 172.21.15.2:0/1113067753 wait complete. 2024-05-14T15:15:40.269 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T15:15:40.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T15:15:40.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.606+0000 7feffca00640 1 Processor -- start 2024-05-14T15:15:40.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.606+0000 7feffca00640 1 -- start start 2024-05-14T15:15:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feffca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feff806d700 0x7feff806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feffca00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feff80af130 0x7feff80af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feffca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff806e050 con 0x7feff806fbd0 2024-05-14T15:15:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feffca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7feff806f180 con 0x7feff806d700 2024-05-14T15:15:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feffca00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7feff8164590 con 0x7feff80af130 2024-05-14T15:15:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7fefefe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feff806d700 0x7feff806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feff7400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feff806fbd0 0x7feff8163af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49848/0 (socket says 172.21.15.2:49848) 2024-05-14T15:15:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.609+0000 7feff7400640 1 -- 172.21.15.2:0/221243146 learned_addr learned my addr 172.21.15.2:0/221243146 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.610+0000 7feff7e00640 1 --2- 172.21.15.2:0/221243146 >> v2:172.21.15.156:3300/0 conn(0x7feff80af130 0x7feff80af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.610+0000 7fefefe00640 1 -- 172.21.15.2:0/221243146 >> v2:172.21.15.156:3300/0 conn(0x7feff80af130 msgr2=0x7feff80af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.610+0000 7fefefe00640 1 --2- 172.21.15.2:0/221243146 >> v2:172.21.15.156:3300/0 conn(0x7feff80af130 0x7feff80af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.610+0000 7fefefe00640 1 -- 172.21.15.2:0/221243146 >> v1:172.21.15.2:6789/0 conn(0x7feff806fbd0 legacy=0x7feff8163af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.610+0000 7fefefe00640 1 -- 172.21.15.2:0/221243146 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff8164870 con 0x7feff806d700 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.610+0000 7feff6a00640 1 -- 172.21.15.2:0/221243146 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803789089 0 0) 0x7fefe8001110 con 0x7feff806fbd0 2024-05-14T15:15:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.611+0000 7fefefe00640 1 --2- 172.21.15.2:0/221243146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff806d700 0x7feff806db10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feff80712b0 tx=0x7fefe002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872e03939f245cb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.612+0000 7feff6a00640 1 -- 172.21.15.2:0/221243146 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0037070 con 0x7feff806d700 2024-05-14T15:15:40.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.612+0000 7feff6a00640 1 -- 172.21.15.2:0/221243146 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe002add0 con 0x7feff806d700 2024-05-14T15:15:40.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.612+0000 7feff6a00640 1 -- 172.21.15.2:0/221243146 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0032660 con 0x7feff806d700 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.612+0000 7feffca00640 1 -- 172.21.15.2:0/221243146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff806d700 msgr2=0x7feff806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.612+0000 7feffca00640 1 --2- 172.21.15.2:0/221243146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff806d700 0x7feff806db10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feff80712b0 tx=0x7fefe002a080 comp rx=0 tx=0).stop 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.613+0000 7feffca00640 1 -- 172.21.15.2:0/221243146 shutdown_connections 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.613+0000 7feffca00640 1 --2- 172.21.15.2:0/221243146 >> v2:172.21.15.156:3300/0 conn(0x7feff80af130 0x7feff80af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.613+0000 7feffca00640 1 --2- 172.21.15.2:0/221243146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff806d700 0x7feff806db10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.613+0000 7feffca00640 1 -- 172.21.15.2:0/221243146 >> 172.21.15.2:0/221243146 conn(0x7feff80732e0 msgr2=0x7feff80736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.613+0000 7feffca00640 1 -- 172.21.15.2:0/221243146 shutdown_connections 2024-05-14T15:15:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.613+0000 7feffca00640 1 -- 172.21.15.2:0/221243146 wait complete. 2024-05-14T15:15:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.615+0000 7feffca00640 1 Processor -- start 2024-05-14T15:15:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.615+0000 7feffca00640 1 -- start start 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feffca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feff806d700 0x7feff80cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feffca00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feff806fbd0 0x7feff8147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feffca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 0x7feff8162960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feffca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feff8070f20 con 0x7feff80af130 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feffca00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7feff806f6b0 con 0x7feff806d700 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feffca00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7feff8164200 con 0x7feff806fbd0 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feff7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 0x7feff8162960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feff7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 0x7feff8162960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40764/0 (socket says 172.21.15.2:40764) 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.617+0000 7feff7e00640 1 -- 172.21.15.2:0/1849343027 learned_addr learned my addr 172.21.15.2:0/1849343027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7400640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feff806d700 0x7feff80cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7fefefe00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feff806fbd0 0x7feff8147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7e00640 1 -- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feff806fbd0 msgr2=0x7feff8147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7e00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feff806fbd0 0x7feff8147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7e00640 1 -- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feff806d700 msgr2=0x7feff80cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7e00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feff806d700 0x7feff80cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7e00640 1 -- 172.21.15.2:0/1849343027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81488b0 con 0x7feff80af130 2024-05-14T15:15:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7feff7e00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 0x7feff8162960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feff0007d80 tx=0x7feff000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0014420 con 0x7feff80af130 2024-05-14T15:15:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.618+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff0019070 con 0x7feff80af130 2024-05-14T15:15:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.619+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff81f6a00 con 0x7feff80af130 2024-05-14T15:15:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.619+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0014800 con 0x7feff80af130 2024-05-14T15:15:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.619+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff815bb40 con 0x7feff80af130 2024-05-14T15:15:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.620+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff81f6810 con 0x7feff80af130 2024-05-14T15:15:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.621+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feff00149a0 con 0x7feff80af130 2024-05-14T15:15:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.622+0000 7fefef400640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fefd40762d0 0x7fefd40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.623+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7feff0097bc0 con 0x7feff80af130 2024-05-14T15:15:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.623+0000 7feff7400640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fefd40762d0 0x7fefd40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.624+0000 7feff7400640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fefd40762d0 0x7fefd40787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fefe8000f60 tx=0x7fefe8007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.628+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feff0061750 con 0x7feff80af130 2024-05-14T15:15:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:40.843+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7feff8148640 con 0x7feff80af130 2024-05-14T15:15:41.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.369+0000 7fefef400640 1 -- 172.21.15.2:0/1849343027 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7feff0061050 con 0x7feff80af130 2024-05-14T15:15:41.368 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-05-14T15:15:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fefd40762d0 msgr2=0x7fefd40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fefd40762d0 0x7fefd40787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fefe8000f60 tx=0x7fefe8007c00 comp rx=0 tx=0).stop 2024-05-14T15:15:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 msgr2=0x7feff8162960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 0x7feff8162960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feff0007d80 tx=0x7feff000e4b0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 shutdown_connections 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fefd40762d0 0x7fefd40787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feff80af130 0x7feff8162960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feff806fbd0 0x7feff8147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 --2- 172.21.15.2:0/1849343027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feff806d700 0x7feff80cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.374+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 >> 172.21.15.2:0/1849343027 conn(0x7feff80732e0 msgr2=0x7feff80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.375+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 shutdown_connections 2024-05-14T15:15:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.375+0000 7feffca00640 1 -- 172.21.15.2:0/1849343027 wait complete. 2024-05-14T15:15:41.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-14T15:15:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.691+0000 7f0a87e00640 1 Processor -- start 2024-05-14T15:15:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.691+0000 7f0a87e00640 1 -- start start 2024-05-14T15:15:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.693+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a8815fa10 0x7f0a880af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.693+0000 7f0a87e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a880cdff0 0x7f0a8806fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.693+0000 7f0a87e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880af620 con 0x7f0a88070360 2024-05-14T15:15:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.693+0000 7f0a87e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f0a880af900 con 0x7f0a880cdff0 2024-05-14T15:15:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.693+0000 7f0a87e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8806f0f0 con 0x7f0a8815fa10 2024-05-14T15:15:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.694+0000 7f0a86000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a880cdff0 0x7f0a8806fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.694+0000 7f0a86a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a8815fa10 0x7f0a880af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.694+0000 7f0a86000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a880cdff0 0x7f0a8806fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:38636/0 (socket says 172.21.15.2:38636) 2024-05-14T15:15:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.694+0000 7f0a86000640 1 -- 172.21.15.2:0/603102293 learned_addr learned my addr 172.21.15.2:0/603102293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.695+0000 7f0a86000640 1 -- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a8815fa10 msgr2=0x7f0a880af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.695+0000 7f0a86000640 1 --2- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a8815fa10 0x7f0a880af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.695+0000 7f0a86000640 1 -- 172.21.15.2:0/603102293 >> v1:172.21.15.156:6789/0 conn(0x7f0a88070360 legacy=0x7f0a8815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.695+0000 7f0a86000640 1 -- 172.21.15.2:0/603102293 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8806f340 con 0x7f0a880cdff0 2024-05-14T15:15:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.695+0000 7f0a86a00640 1 --2- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a8815fa10 0x7f0a880af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.697+0000 7f0a86000640 1 --2- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a880cdff0 0x7f0a8806fe20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009870 tx=0x7f0a7402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60e40aebb3835634 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.697+0000 7f0a85600640 1 -- 172.21.15.2:0/603102293 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74037070 con 0x7f0a880cdff0 2024-05-14T15:15:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.697+0000 7f0a85600640 1 -- 172.21.15.2:0/603102293 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a74032440 con 0x7f0a880cdff0 2024-05-14T15:15:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.697+0000 7f0a85600640 1 -- 172.21.15.2:0/603102293 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74032810 con 0x7f0a880cdff0 2024-05-14T15:15:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 -- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a880cdff0 msgr2=0x7f0a8806fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 --2- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a880cdff0 0x7f0a8806fe20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009870 tx=0x7f0a7402a270 comp rx=0 tx=0).stop 2024-05-14T15:15:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 -- 172.21.15.2:0/603102293 shutdown_connections 2024-05-14T15:15:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 --2- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a880cdff0 0x7f0a8806fe20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 --2- 172.21.15.2:0/603102293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a8815fa10 0x7f0a880af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 -- 172.21.15.2:0/603102293 >> 172.21.15.2:0/603102293 conn(0x7f0a880739a0 msgr2=0x7f0a88073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 -- 172.21.15.2:0/603102293 shutdown_connections 2024-05-14T15:15:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.698+0000 7f0a87e00640 1 -- 172.21.15.2:0/603102293 wait complete. 2024-05-14T15:15:41.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.701+0000 7f0a87e00640 1 Processor -- start 2024-05-14T15:15:41.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.701+0000 7f0a87e00640 1 -- start start 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.702+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a88070360 0x7f0a8814a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.702+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a880cdff0 0x7f0a8815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.702+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 0x7f0a881532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.702+0000 7f0a87e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880ce580 con 0x7f0a8815fa10 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.702+0000 7f0a87e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880ce400 con 0x7f0a88070360 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.702+0000 7f0a87e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880b0fd0 con 0x7f0a880cdff0 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 0x7f0a881532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 0x7f0a881532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40780/0 (socket says 172.21.15.2:40780) 2024-05-14T15:15:41.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 -- 172.21.15.2:0/4000279091 learned_addr learned my addr 172.21.15.2:0/4000279091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a86a00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a88070360 0x7f0a8814a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a86000640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a880cdff0 0x7f0a8815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 -- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a880cdff0 msgr2=0x7f0a8815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a880cdff0 0x7f0a8815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 -- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a88070360 msgr2=0x7f0a8814a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a88070360 0x7f0a8814a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a87400640 1 -- 172.21.15.2:0/4000279091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8814aab0 con 0x7f0a8815fa10 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.703+0000 7f0a86000640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a880cdff0 0x7f0a8815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:41.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.704+0000 7f0a87400640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 0x7f0a881532c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c6e0 tx=0x7f0a8000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.704+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80003b70 con 0x7f0a8815fa10 2024-05-14T15:15:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.704+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a80003d10 con 0x7f0a8815fa10 2024-05-14T15:15:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.704+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a800052f0 con 0x7f0a8815fa10 2024-05-14T15:15:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.704+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a881e5da0 con 0x7f0a8815fa10 2024-05-14T15:15:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.704+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a88156690 con 0x7f0a8815fa10 2024-05-14T15:15:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.705+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a88050870 con 0x7f0a8815fa10 2024-05-14T15:15:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.707+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a80005490 con 0x7f0a8815fa10 2024-05-14T15:15:41.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.709+0000 7f0a7ea00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0a680762d0 0x7f0a680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.709+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f0a80097230 con 0x7f0a8815fa10 2024-05-14T15:15:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.709+0000 7f0a86a00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0a680762d0 0x7f0a680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.710+0000 7f0a86a00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0a680762d0 0x7f0a680787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800a570 tx=0x7f0a7800a2a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:41.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.714+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0a8814aab0 con 0x7f0a8815fa10 2024-05-14T15:15:41.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:41.927+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f0a880b5df0 con 0x7f0a8815fa10 2024-05-14T15:15:42.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.377+0000 7f0a7ea00640 1 -- 172.21.15.2:0/4000279091 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f0a80060cf0 con 0x7f0a8815fa10 2024-05-14T15:15:42.376 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-05-14T15:15:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.381+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0a680762d0 msgr2=0x7f0a680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.381+0000 7f0a87e00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0a680762d0 0x7f0a680787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800a570 tx=0x7f0a7800a2a0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.381+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 msgr2=0x7f0a881532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.381+0000 7f0a87e00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 0x7f0a881532c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c6e0 tx=0x7f0a8000cba0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 shutdown_connections 2024-05-14T15:15:42.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0a680762d0 0x7f0a680787e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a8815fa10 0x7f0a881532c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a880cdff0 0x7f0a8815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 --2- 172.21.15.2:0/4000279091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a88070360 0x7f0a8814a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 >> 172.21.15.2:0/4000279091 conn(0x7f0a880739a0 msgr2=0x7f0a880b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.382+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 shutdown_connections 2024-05-14T15:15:42.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.383+0000 7f0a87e00640 1 -- 172.21.15.2:0/4000279091 wait complete. 2024-05-14T15:15:42.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T15:15:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.691+0000 7f7996400640 1 Processor -- start 2024-05-14T15:15:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.691+0000 7f7996400640 1 -- start start 2024-05-14T15:15:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.694+0000 7f7996400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7990168a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.694+0000 7f7996400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79900aee60 con 0x7f79900709e0 2024-05-14T15:15:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.694+0000 7f7996400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79900af140 con 0x7f79901618e0 2024-05-14T15:15:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.694+0000 7f7996400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f79900af420 con 0x7f79900d0920 2024-05-14T15:15:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.694+0000 7f7995000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f79900709e0 0x7f79900b0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49856/0 (socket says 172.21.15.2:49856) 2024-05-14T15:15:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.694+0000 7f7995000640 1 -- 172.21.15.2:0/1957120615 learned_addr learned my addr 172.21.15.2:0/1957120615 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f7995a00640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7990168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197501211 0 0) 0x7f79900aee60 con 0x7f79900709e0 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7978003520 con 0x7f79900709e0 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2208005239 0 0) 0x7f7978003520 con 0x7f79900709e0 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 msgr2=0x7f7990168a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7990168a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 >> v1:172.21.15.156:6789/0 conn(0x7f79901618e0 legacy=0x7f7990161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79900af700 con 0x7f79900709e0 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f79840016f0 con 0x7f79900709e0 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 >> v1:172.21.15.2:6789/0 conn(0x7f79900709e0 legacy=0x7f79900b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978003a30 0x7f7978003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7978004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978004d40 0x7f79780051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79900af420 con 0x7f7978003a30 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f797800bc20 con 0x7f7978004d40 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f797800be20 con 0x7f79900d0920 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.695+0000 7f7995000640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978003a30 0x7f7978003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995a00640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978004d40 0x7f79780051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f798fe00640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7978004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995000640 1 -- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 msgr2=0x7f7978004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995000640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7978004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995000640 1 -- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978004d40 msgr2=0x7f79780051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995000640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978004d40 0x7f79780051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995000640 1 -- 172.21.15.2:0/1957120615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7978003520 con 0x7f7978003a30 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f7995a00640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978004d40 0x7f79780051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.696+0000 7f798fe00640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900d0920 0x7f7978004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:42.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.697+0000 7f7995000640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978003a30 0x7f7978003ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f798400c210 tx=0x7f7978005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f4e51b1209d6bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.697+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984007d60 con 0x7f7978003a30 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.697+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984005ad0 con 0x7f7978003a30 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.697+0000 7f798f400640 1 -- 172.21.15.2:0/1957120615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984007070 con 0x7f7978003a30 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7996400640 1 -- 172.21.15.2:0/1957120615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978003a30 msgr2=0x7f7978003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7996400640 1 --2- 172.21.15.2:0/1957120615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7978003a30 0x7f7978003ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f798400c210 tx=0x7f7978005830 comp rx=0 tx=0).stop 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7995a00640 1 -- 172.21.15.2:0/1957120615 reap_dead start 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7996400640 1 -- 172.21.15.2:0/1957120615 shutdown_connections 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7996400640 1 -- 172.21.15.2:0/1957120615 >> 172.21.15.2:0/1957120615 conn(0x7f79900739a0 msgr2=0x7f7990073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7996400640 1 -- 172.21.15.2:0/1957120615 shutdown_connections 2024-05-14T15:15:42.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.698+0000 7f7996400640 1 -- 172.21.15.2:0/1957120615 wait complete. 2024-05-14T15:15:42.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.701+0000 7f7996400640 1 Processor -- start 2024-05-14T15:15:42.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.701+0000 7f7996400640 1 -- start start 2024-05-14T15:15:42.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.702+0000 7f7996400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978003a30 0x7f79901f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.702+0000 7f7996400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 0x7f79901597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f7996400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900b5530 0x7f79900b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f7996400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79901626c0 con 0x7f79901593d0 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f7996400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7990070df0 con 0x7f7978003a30 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f7996400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f79900aea80 con 0x7f79900b5530 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 0x7f79901597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 0x7f79901597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40796/0 (socket says 172.21.15.2:40796) 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 -- 172.21.15.2:0/3349021013 learned_addr learned my addr 172.21.15.2:0/3349021013 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f7995000640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978003a30 0x7f79901f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f7995a00640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900b5530 0x7f79900b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 -- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900b5530 msgr2=0x7f79900b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900b5530 0x7f79900b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 -- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978003a30 msgr2=0x7f79901f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978003a30 0x7f79901f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.703+0000 7f798fe00640 1 -- 172.21.15.2:0/3349021013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79900b5e80 con 0x7f79901593d0 2024-05-14T15:15:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.704+0000 7f798fe00640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 0x7f79901597e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f797c00d770 tx=0x7f797c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.704+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c005070 con 0x7f79901593d0 2024-05-14T15:15:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.704+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c005210 con 0x7f79901593d0 2024-05-14T15:15:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.704+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7990152ba0 con 0x7f79901593d0 2024-05-14T15:15:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.704+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c0067d0 con 0x7f79901593d0 2024-05-14T15:15:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.704+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7990153160 con 0x7f79901593d0 2024-05-14T15:15:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.705+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7990050870 con 0x7f79901593d0 2024-05-14T15:15:42.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.707+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f797c01a020 con 0x7f79901593d0 2024-05-14T15:15:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.708+0000 7f798cc00640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7970076320 0x7f7970078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.708+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f797c096d20 con 0x7f79901593d0 2024-05-14T15:15:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.709+0000 7f7995000640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7970076320 0x7f7970078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:42.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.710+0000 7f7995000640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7970076320 0x7f7970078830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7984032000 tx=0x7f7984007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:42.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.715+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f79900b5e80 con 0x7f79901593d0 2024-05-14T15:15:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:42.976+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7990068d20 con 0x7f79901593d0 2024-05-14T15:15:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.433+0000 7f798cc00640 1 -- 172.21.15.2:0/3349021013 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f797c0606c0 con 0x7f79901593d0 2024-05-14T15:15:43.436 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T15:15:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.444+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7970076320 msgr2=0x7f7970078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.444+0000 7f7996400640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7970076320 0x7f7970078830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7984032000 tx=0x7f7984007000 comp rx=0 tx=0).stop 2024-05-14T15:15:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.444+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 msgr2=0x7f79901597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.444+0000 7f7996400640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 0x7f79901597e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f797c00d770 tx=0x7f797c00dc30 comp rx=0 tx=0).stop 2024-05-14T15:15:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.445+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 shutdown_connections 2024-05-14T15:15:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.445+0000 7f7996400640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7970076320 0x7f7970078830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.445+0000 7f7996400640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79900b5530 0x7f79900b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.445+0000 7f7996400640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79901593d0 0x7f79901597e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.445+0000 7f7996400640 1 --2- 172.21.15.2:0/3349021013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7978003a30 0x7f79901f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.445+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 >> 172.21.15.2:0/3349021013 conn(0x7f79900739a0 msgr2=0x7f7990156820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.447+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 shutdown_connections 2024-05-14T15:15:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.447+0000 7f7996400640 1 -- 172.21.15.2:0/3349021013 wait complete. 2024-05-14T15:15:43.484 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-14T15:15:43.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-14T15:15:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.743+0000 7f2fd8200640 1 Processor -- start 2024-05-14T15:15:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.743+0000 7f2fd8200640 1 -- start start 2024-05-14T15:15:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd8200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2fd015cf60 0x7f2fd00ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd8200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd00aeea0 0x7f2fd006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd8200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fd006dc40 0x7f2fd00705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd8200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd00af2b0 con 0x7f2fd006dc40 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd8200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd00b4950 con 0x7f2fd015cf60 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd8200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd006e050 con 0x7f2fd00aeea0 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd6200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fd006dc40 0x7f2fd00705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd6200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fd006dc40 0x7f2fd00705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40806/0 (socket says 172.21.15.2:40806) 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd6200640 1 -- 172.21.15.2:0/4078506375 learned_addr learned my addr 172.21.15.2:0/4078506375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd5800640 1 --2- 172.21.15.2:0/4078506375 >> v2:172.21.15.156:3300/0 conn(0x7f2fd015cf60 0x7f2fd00ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.746+0000 7f2fd4e00640 1 --2- 172.21.15.2:0/4078506375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd00aeea0 0x7f2fd006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.747+0000 7f2fd6200640 1 -- 172.21.15.2:0/4078506375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd00aeea0 msgr2=0x7f2fd006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.747+0000 7f2fd6200640 1 --2- 172.21.15.2:0/4078506375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd00aeea0 0x7f2fd006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.747+0000 7f2fd6200640 1 -- 172.21.15.2:0/4078506375 >> v2:172.21.15.156:3300/0 conn(0x7f2fd015cf60 msgr2=0x7f2fd00ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.747+0000 7f2fd6200640 1 --2- 172.21.15.2:0/4078506375 >> v2:172.21.15.156:3300/0 conn(0x7f2fd015cf60 0x7f2fd00ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.747+0000 7f2fd6200640 1 -- 172.21.15.2:0/4078506375 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd0161870 con 0x7f2fd006dc40 2024-05-14T15:15:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.748+0000 7f2fd6200640 1 --2- 172.21.15.2:0/4078506375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd006dc40 0x7f2fd00705d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00719d0 tx=0x7f2fc802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9de25c647a8e5c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.748+0000 7f2fcfe00640 1 -- 172.21.15.2:0/4078506375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8036070 con 0x7f2fd006dc40 2024-05-14T15:15:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.749+0000 7f2fcfe00640 1 -- 172.21.15.2:0/4078506375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc8031600 con 0x7f2fd006dc40 2024-05-14T15:15:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.749+0000 7f2fcfe00640 1 -- 172.21.15.2:0/4078506375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80319d0 con 0x7f2fd006dc40 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.749+0000 7f2fd8200640 1 -- 172.21.15.2:0/4078506375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd006dc40 msgr2=0x7f2fd00705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4078506375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd006dc40 0x7f2fd00705d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00719d0 tx=0x7f2fc802a610 comp rx=0 tx=0).stop 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 -- 172.21.15.2:0/4078506375 shutdown_connections 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4078506375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd006dc40 0x7f2fd00705d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4078506375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd00aeea0 0x7f2fd006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4078506375 >> v2:172.21.15.156:3300/0 conn(0x7f2fd015cf60 0x7f2fd00ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 -- 172.21.15.2:0/4078506375 >> 172.21.15.2:0/4078506375 conn(0x7f2fd00d1d10 msgr2=0x7f2fd00734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 -- 172.21.15.2:0/4078506375 shutdown_connections 2024-05-14T15:15:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.750+0000 7f2fd8200640 1 -- 172.21.15.2:0/4078506375 wait complete. 2024-05-14T15:15:43.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.753+0000 7f2fd8200640 1 Processor -- start 2024-05-14T15:15:43.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.753+0000 7f2fd8200640 1 -- start start 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd8200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd006dc40 0x7f2fd0141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd8200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 0x7f2fd01f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd8200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fd015cf60 0x7f2fd0152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd8200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0161070 con 0x7f2fd00aeea0 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd8200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0160d90 con 0x7f2fd015cf60 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd8200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd0161350 con 0x7f2fd006dc40 2024-05-14T15:15:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 0x7f2fd01f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 0x7f2fd01f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40812/0 (socket says 172.21.15.2:40812) 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.755+0000 7f2fd4e00640 1 -- 172.21.15.2:0/4111427817 learned_addr learned my addr 172.21.15.2:0/4111427817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd5800640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd006dc40 0x7f2fd0141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd6200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fd015cf60 0x7f2fd0152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd4e00640 1 -- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd006dc40 msgr2=0x7f2fd0141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd4e00640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd006dc40 0x7f2fd0141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd4e00640 1 -- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fd015cf60 msgr2=0x7f2fd0152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd4e00640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fd015cf60 0x7f2fd0152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd4e00640 1 -- 172.21.15.2:0/4111427817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd01f65a0 con 0x7f2fd00aeea0 2024-05-14T15:15:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fd4e00640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 0x7f2fd01f56e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000e870 tx=0x7f2fc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.756+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0017070 con 0x7f2fd00aeea0 2024-05-14T15:15:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.757+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc000c940 con 0x7f2fd00aeea0 2024-05-14T15:15:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.757+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000cd30 con 0x7f2fd00aeea0 2024-05-14T15:15:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.757+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd01f62c0 con 0x7f2fd00aeea0 2024-05-14T15:15:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.757+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd01417d0 con 0x7f2fd00aeea0 2024-05-14T15:15:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.758+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd01f6030 con 0x7f2fd00aeea0 2024-05-14T15:15:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.760+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fc001a070 con 0x7f2fd00aeea0 2024-05-14T15:15:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.761+0000 7f2fcd600640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2fb40762d0 0x7f2fb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.761+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2fc0097d90 con 0x7f2fd00aeea0 2024-05-14T15:15:43.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.761+0000 7f2fd5800640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2fb40762d0 0x7f2fb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:43.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.763+0000 7f2fd5800640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2fb40762d0 0x7f2fb40787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40098f0 tx=0x7f2fc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.765+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fc0061640 con 0x7f2fd00aeea0 2024-05-14T15:15:43.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:43.988+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f2fd00af4d0 con 0x7f2fd00aeea0 2024-05-14T15:15:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.409+0000 7f2fcd600640 1 -- 172.21.15.2:0/4111427817 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f2fd00af4d0 con 0x7f2fd00aeea0 2024-05-14T15:15:44.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.412+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2fb40762d0 msgr2=0x7f2fb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.412+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2fb40762d0 0x7f2fb40787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40098f0 tx=0x7f2fc4008040 comp rx=0 tx=0).stop 2024-05-14T15:15:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.412+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 msgr2=0x7f2fd01f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.412+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 0x7f2fd01f56e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000e870 tx=0x7f2fc000ed30 comp rx=0 tx=0).stop 2024-05-14T15:15:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 shutdown_connections 2024-05-14T15:15:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2fb40762d0 0x7f2fb40787e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fd015cf60 0x7f2fd0152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fd00aeea0 0x7f2fd01f56e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 --2- 172.21.15.2:0/4111427817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fd006dc40 0x7f2fd0141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 >> 172.21.15.2:0/4111427817 conn(0x7f2fd00d1d10 msgr2=0x7f2fd00b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 shutdown_connections 2024-05-14T15:15:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.413+0000 7f2fd8200640 1 -- 172.21.15.2:0/4111427817 wait complete. 2024-05-14T15:15:44.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T15:15:44.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.736+0000 7fbcafe00640 1 Processor -- start 2024-05-14T15:15:44.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.736+0000 7fbcafe00640 1 -- start start 2024-05-14T15:15:44.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbcafe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbcb015d760 0x7fbcb015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:44.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbcafe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb0160c90 con 0x7fbcb00cdd80 2024-05-14T15:15:44.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbcafe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb0160f70 con 0x7fbcb0160720 2024-05-14T15:15:44.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbcafe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb015ab00 con 0x7fbcb015d760 2024-05-14T15:15:44.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbcaf400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbcb015d760 0x7fbcb015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:44.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbca7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbcb00cdd80 0x7fbcb00b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49864/0 (socket says 172.21.15.2:49864) 2024-05-14T15:15:44.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.738+0000 7fbca7e00640 1 -- 172.21.15.2:0/224548999 learned_addr learned my addr 172.21.15.2:0/224548999 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:44.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.739+0000 7fbcaf400640 1 -- 172.21.15.2:0/224548999 >> v1:172.21.15.156:6789/0 conn(0x7fbcb0160720 legacy=0x7fbcb00b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:44.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.739+0000 7fbcaf400640 1 -- 172.21.15.2:0/224548999 >> v1:172.21.15.2:6789/0 conn(0x7fbcb00cdd80 legacy=0x7fbcb00b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:44.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.739+0000 7fbcae000640 1 -- 172.21.15.2:0/224548999 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467701608 0 0) 0x7fbcb0160c90 con 0x7fbcb00cdd80 2024-05-14T15:15:44.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.739+0000 7fbcaf400640 1 -- 172.21.15.2:0/224548999 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb0161250 con 0x7fbcb015d760 2024-05-14T15:15:44.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.740+0000 7fbcaf400640 1 --2- 172.21.15.2:0/224548999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb015d760 0x7fbcb015db70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009d90 tx=0x7fbca802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c163bd6070c0349b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:44.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.740+0000 7fbcae000640 1 -- 172.21.15.2:0/224548999 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8031600 con 0x7fbcb015d760 2024-05-14T15:15:44.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.740+0000 7fbcae000640 1 -- 172.21.15.2:0/224548999 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca80317a0 con 0x7fbcb015d760 2024-05-14T15:15:44.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.740+0000 7fbcae000640 1 -- 172.21.15.2:0/224548999 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8031b70 con 0x7fbcb015d760 2024-05-14T15:15:44.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 -- 172.21.15.2:0/224548999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb015d760 msgr2=0x7fbcb015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:44.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 --2- 172.21.15.2:0/224548999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb015d760 0x7fbcb015db70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009d90 tx=0x7fbca802a5d0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 -- 172.21.15.2:0/224548999 shutdown_connections 2024-05-14T15:15:44.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 --2- 172.21.15.2:0/224548999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb015d760 0x7fbcb015db70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 -- 172.21.15.2:0/224548999 >> 172.21.15.2:0/224548999 conn(0x7fbcb00739a0 msgr2=0x7fbcb0073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:44.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 -- 172.21.15.2:0/224548999 shutdown_connections 2024-05-14T15:15:44.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.741+0000 7fbcafe00640 1 -- 172.21.15.2:0/224548999 wait complete. 2024-05-14T15:15:44.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.744+0000 7fbcafe00640 1 Processor -- start 2024-05-14T15:15:44.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.744+0000 7fbcafe00640 1 -- start start 2024-05-14T15:15:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.745+0000 7fbcafe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 0x7fbcb01f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.745+0000 7fbcafe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcb015d760 0x7fbcb00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.745+0000 7fbcafe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcb0160720 0x7fbcb015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.745+0000 7fbcafe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb00b4d80 con 0x7fbcb00cdd80 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.745+0000 7fbcafe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb0161530 con 0x7fbcb015d760 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.745+0000 7fbcafe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb009dbe0 con 0x7fbcb0160720 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 0x7fbcb01f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 0x7fbcb01f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40840/0 (socket says 172.21.15.2:40840) 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 -- 172.21.15.2:0/867341514 learned_addr learned my addr 172.21.15.2:0/867341514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbca7e00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcb015d760 0x7fbcb00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaf400640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcb0160720 0x7fbcb015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 -- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcb0160720 msgr2=0x7fbcb015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcb0160720 0x7fbcb015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 -- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcb015d760 msgr2=0x7fbcb00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcb015d760 0x7fbcb00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaea00640 1 -- 172.21.15.2:0/867341514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb00aed90 con 0x7fbcb00cdd80 2024-05-14T15:15:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.746+0000 7fbcaf400640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcb0160720 0x7fbcb015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.747+0000 7fbcaea00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 0x7fbcb01f5c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbca000b420 tx=0x7fbca000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.747+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0011830 con 0x7fbcb00cdd80 2024-05-14T15:15:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.747+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca0016070 con 0x7fbcb00cdd80 2024-05-14T15:15:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.747+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0011c10 con 0x7fbcb00cdd80 2024-05-14T15:15:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.747+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb00cb5a0 con 0x7fbcb00cdd80 2024-05-14T15:15:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.747+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb009d920 con 0x7fbcb00cdd80 2024-05-14T15:15:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.748+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb0050870 con 0x7fbcb00cdd80 2024-05-14T15:15:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.749+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbca001b460 con 0x7fbcb00cdd80 2024-05-14T15:15:44.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.750+0000 7fbca6a00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc8c076300 0x7fbc8c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.751+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7fbca00972d0 con 0x7fbcb00cdd80 2024-05-14T15:15:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.751+0000 7fbca7e00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc8c076300 0x7fbc8c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.752+0000 7fbca7e00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc8c076300 0x7fbc8c078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0152ce0 tx=0x7fbc98007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:44.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.755+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbca0020020 con 0x7fbcb00cdd80 2024-05-14T15:15:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:44.971+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbcb00b6370 con 0x7fbcb00cdd80 2024-05-14T15:15:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.430+0000 7fbca6a00640 1 -- 172.21.15.2:0/867341514 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7fbca00609d0 con 0x7fbcb00cdd80 2024-05-14T15:15:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' created 2024-05-14T15:15:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc8c076300 msgr2=0x7fbc8c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc8c076300 0x7fbc8c078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0152ce0 tx=0x7fbc98007c00 comp rx=0 tx=0).stop 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 msgr2=0x7fbcb01f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 0x7fbcb01f5c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbca000b420 tx=0x7fbca000b8e0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 shutdown_connections 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc8c076300 0x7fbc8c078810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcb015d760 0x7fbcb00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcb0160720 0x7fbcb015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 --2- 172.21.15.2:0/867341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb00cdd80 0x7fbcb01f5c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.435+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 >> 172.21.15.2:0/867341514 conn(0x7fbcb00739a0 msgr2=0x7fbcb0073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.436+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 shutdown_connections 2024-05-14T15:15:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.436+0000 7fbcafe00640 1 -- 172.21.15.2:0/867341514 wait complete. 2024-05-14T15:15:46.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-14T15:15:46.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.732+0000 7f1bffe00640 1 Processor -- start 2024-05-14T15:15:46.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.732+0000 7f1bffe00640 1 -- start start 2024-05-14T15:15:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bffe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c000b56a0 0x7f1c000b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bffe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0015ca80 0x7f1c000b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bffe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c000b5ab0 con 0x7f1c0006d700 2024-05-14T15:15:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bffe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1c000b0a70 con 0x7f1c000b56a0 2024-05-14T15:15:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bffe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1c000b0d10 con 0x7f1c0015ca80 2024-05-14T15:15:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bfea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c000b56a0 0x7f1c000b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bff400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1c0006d700 0x7f1c0006db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49874/0 (socket says 172.21.15.2:49874) 2024-05-14T15:15:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bff400640 1 -- 172.21.15.2:0/3113672441 learned_addr learned my addr 172.21.15.2:0/3113672441 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.735+0000 7f1bfe000640 1 --2- 172.21.15.2:0/3113672441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0015ca80 0x7f1c000b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.736+0000 7f1bfea00640 1 -- 172.21.15.2:0/3113672441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0015ca80 msgr2=0x7f1c000b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.736+0000 7f1bfea00640 1 --2- 172.21.15.2:0/3113672441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0015ca80 0x7f1c000b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.736+0000 7f1bfea00640 1 -- 172.21.15.2:0/3113672441 >> v1:172.21.15.2:6789/0 conn(0x7f1c0006d700 legacy=0x7f1c0006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.736+0000 7f1bfea00640 1 -- 172.21.15.2:0/3113672441 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c000b0ff0 con 0x7f1c000b56a0 2024-05-14T15:15:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.736+0000 7f1bfd600640 1 -- 172.21.15.2:0/3113672441 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327022332 0 0) 0x7f1bf8001490 con 0x7f1c0006d700 2024-05-14T15:15:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.737+0000 7f1bfea00640 1 --2- 172.21.15.2:0/3113672441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000b56a0 0x7f1c000b64e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00097d0 tx=0x7f1bf002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed4744661072c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.738+0000 7f1bfd600640 1 -- 172.21.15.2:0/3113672441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0037070 con 0x7f1c000b56a0 2024-05-14T15:15:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.738+0000 7f1bfd600640 1 -- 172.21.15.2:0/3113672441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf0032440 con 0x7f1c000b56a0 2024-05-14T15:15:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.738+0000 7f1bfd600640 1 -- 172.21.15.2:0/3113672441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0032810 con 0x7f1c000b56a0 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 -- 172.21.15.2:0/3113672441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000b56a0 msgr2=0x7f1c000b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3113672441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000b56a0 0x7f1c000b64e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00097d0 tx=0x7f1bf002a1c0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 -- 172.21.15.2:0/3113672441 shutdown_connections 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3113672441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0015ca80 0x7f1c000b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3113672441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000b56a0 0x7f1c000b64e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 -- 172.21.15.2:0/3113672441 >> 172.21.15.2:0/3113672441 conn(0x7f1c000732e0 msgr2=0x7f1c000736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 -- 172.21.15.2:0/3113672441 shutdown_connections 2024-05-14T15:15:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.739+0000 7f1bffe00640 1 -- 172.21.15.2:0/3113672441 wait complete. 2024-05-14T15:15:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.742+0000 7f1bffe00640 1 Processor -- start 2024-05-14T15:15:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.742+0000 7f1bffe00640 1 -- start start 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.744+0000 7f1bffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0006d700 0x7f1c0014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.744+0000 7f1bffe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c000b56a0 0x7f1c001e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.744+0000 7f1bffe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 0x7f1c001e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.744+0000 7f1bffe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c000b5180 con 0x7f1c0015ca80 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.744+0000 7f1bffe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1c000b4ea0 con 0x7f1c0006d700 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.744+0000 7f1bffe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0015ce90 con 0x7f1c000b56a0 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 0x7f1c001e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 0x7f1c001e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40854/0 (socket says 172.21.15.2:40854) 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 -- 172.21.15.2:0/3731329828 learned_addr learned my addr 172.21.15.2:0/3731329828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bfea00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0006d700 0x7f1c0014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bfe000640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c000b56a0 0x7f1c001e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 -- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c000b56a0 msgr2=0x7f1c001e6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c000b56a0 0x7f1c001e6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 -- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0006d700 msgr2=0x7f1c0014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0006d700 0x7f1c0014b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bff400640 1 -- 172.21.15.2:0/3731329828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0015fbd0 con 0x7f1c0015ca80 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bfe000640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c000b56a0 0x7f1c001e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.745+0000 7f1bfea00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0006d700 0x7f1c0014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.746+0000 7f1bff400640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 0x7f1c001e6a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c6b0 tx=0x7f1bf800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.746+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8018070 con 0x7f1c0015ca80 2024-05-14T15:15:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.746+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf8004da0 con 0x7f1c0015ca80 2024-05-14T15:15:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.746+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800a880 con 0x7f1c0015ca80 2024-05-14T15:15:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.746+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0015feb0 con 0x7f1c0015ca80 2024-05-14T15:15:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.746+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c001e7510 con 0x7f1c0015ca80 2024-05-14T15:15:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.748+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c001e7760 con 0x7f1c0015ca80 2024-05-14T15:15:46.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.750+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1bf800aa20 con 0x7f1c0015ca80 2024-05-14T15:15:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.752+0000 7f1bf6a00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1bdc0762d0 0x7f1bdc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.752+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f1bf80973d0 con 0x7f1c0015ca80 2024-05-14T15:15:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.753+0000 7f1bfea00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1bdc0762d0 0x7f1bdc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.754+0000 7f1bfea00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1bdc0762d0 0x7f1bdc0787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0034000 tx=0x7f1bf002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.755+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1bf8021020 con 0x7f1c0015ca80 2024-05-14T15:15:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:46.968+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1c000d0da0 con 0x7f1c0015ca80 2024-05-14T15:15:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.435+0000 7f1bf6a00640 1 -- 172.21.15.2:0/3731329828 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f1c000b5ab0 con 0x7f1c0015ca80 2024-05-14T15:15:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:set pool 4 allow_ec_overwrites to true 2024-05-14T15:15:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1bdc0762d0 msgr2=0x7f1bdc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1bdc0762d0 0x7f1bdc0787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0034000 tx=0x7f1bf002e000 comp rx=0 tx=0).stop 2024-05-14T15:15:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 msgr2=0x7f1c001e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 0x7f1c001e6a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c6b0 tx=0x7f1bf800cb70 comp rx=0 tx=0).stop 2024-05-14T15:15:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 shutdown_connections 2024-05-14T15:15:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1bdc0762d0 0x7f1bdc0787e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0015ca80 0x7f1c001e6a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c000b56a0 0x7f1c001e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 --2- 172.21.15.2:0/3731329828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0006d700 0x7f1c0014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.439+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 >> 172.21.15.2:0/3731329828 conn(0x7f1c000732e0 msgr2=0x7f1c000b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.441+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 shutdown_connections 2024-05-14T15:15:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.444+0000 7f1bffe00640 1 -- 172.21.15.2:0/3731329828 wait complete. 2024-05-14T15:15:47.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-14T15:15:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.747+0000 7f4366a00640 1 Processor -- start 2024-05-14T15:15:47.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.747+0000 7f4366a00640 1 -- start start 2024-05-14T15:15:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f4366a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43600b4ef0 0x7f43601625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f4366a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f436006c6f0 0x7f436006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f4366a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436015e7f0 con 0x7f43600d0ff0 2024-05-14T15:15:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f4366a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f436015f5b0 con 0x7f43600b4ef0 2024-05-14T15:15:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f4366a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f436015ead0 con 0x7f436006c6f0 2024-05-14T15:15:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f435f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43600b4ef0 0x7f43601625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f435fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f43600d0ff0 0x7f43600b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49878/0 (socket says 172.21.15.2:49878) 2024-05-14T15:15:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f435fe00640 1 -- 172.21.15.2:0/3732021367 learned_addr learned my addr 172.21.15.2:0/3732021367 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.751+0000 7f435f400640 1 -- 172.21.15.2:0/3732021367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f436006c6f0 msgr2=0x7f436006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.750+0000 7f4364a00640 1 --2- 172.21.15.2:0/3732021367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f436006c6f0 0x7f436006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.751+0000 7f435f400640 1 --2- 172.21.15.2:0/3732021367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f436006c6f0 0x7f436006cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.751+0000 7f435f400640 1 -- 172.21.15.2:0/3732021367 >> v1:172.21.15.2:6789/0 conn(0x7f43600d0ff0 legacy=0x7f43600b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.751+0000 7f435ea00640 1 -- 172.21.15.2:0/3732021367 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876114401 0 0) 0x7f436015e7f0 con 0x7f43600d0ff0 2024-05-14T15:15:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.751+0000 7f435f400640 1 -- 172.21.15.2:0/3732021367 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436015edb0 con 0x7f43600b4ef0 2024-05-14T15:15:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.752+0000 7f435f400640 1 --2- 172.21.15.2:0/3732021367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43600b4ef0 0x7f43601625e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71805339f9b0796f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.752+0000 7f435ea00640 1 -- 172.21.15.2:0/3732021367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c037070 con 0x7f43600b4ef0 2024-05-14T15:15:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.752+0000 7f435ea00640 1 -- 172.21.15.2:0/3732021367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c032440 con 0x7f43600b4ef0 2024-05-14T15:15:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.752+0000 7f435ea00640 1 -- 172.21.15.2:0/3732021367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c032810 con 0x7f43600b4ef0 2024-05-14T15:15:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 -- 172.21.15.2:0/3732021367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43600b4ef0 msgr2=0x7f43601625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:47.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 --2- 172.21.15.2:0/3732021367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43600b4ef0 0x7f43601625e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02a180 comp rx=0 tx=0).stop 2024-05-14T15:15:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 -- 172.21.15.2:0/3732021367 shutdown_connections 2024-05-14T15:15:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 --2- 172.21.15.2:0/3732021367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f436006c6f0 0x7f436006cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 --2- 172.21.15.2:0/3732021367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43600b4ef0 0x7f43601625e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 -- 172.21.15.2:0/3732021367 >> 172.21.15.2:0/3732021367 conn(0x7f43600ce230 msgr2=0x7f43600ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 -- 172.21.15.2:0/3732021367 shutdown_connections 2024-05-14T15:15:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.753+0000 7f4366a00640 1 -- 172.21.15.2:0/3732021367 wait complete. 2024-05-14T15:15:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.755+0000 7f4366a00640 1 Processor -- start 2024-05-14T15:15:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.756+0000 7f4366a00640 1 -- start start 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4366a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f436006c6f0 0x7f43601470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4366a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43600d0ff0 0x7f43601479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4366a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 0x7f4360159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4366a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f436015be80 con 0x7f4360155b70 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4366a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4360071640 con 0x7f436006c6f0 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4366a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f436015c000 con 0x7f43600d0ff0 2024-05-14T15:15:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4364a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 0x7f4360159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4364a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 0x7f4360159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40878/0 (socket says 172.21.15.2:40878) 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.757+0000 7f4364a00640 1 -- 172.21.15.2:0/2971085466 learned_addr learned my addr 172.21.15.2:0/2971085466 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f435f400640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43600d0ff0 0x7f43601479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f435fe00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f436006c6f0 0x7f43601470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f4364a00640 1 -- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43600d0ff0 msgr2=0x7f43601479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f4364a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43600d0ff0 0x7f43601479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f4364a00640 1 -- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f436006c6f0 msgr2=0x7f43601470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f4364a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f436006c6f0 0x7f43601470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f4364a00640 1 -- 172.21.15.2:0/2971085466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43601547b0 con 0x7f4360155b70 2024-05-14T15:15:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.758+0000 7f4364a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 0x7f4360159db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f435800ccb0 tx=0x7f435800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.759+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435800ce60 con 0x7f4360155b70 2024-05-14T15:15:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.759+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4358003990 con 0x7f4360155b70 2024-05-14T15:15:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.759+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358003da0 con 0x7f4360155b70 2024-05-14T15:15:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.759+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4360158d10 con 0x7f4360155b70 2024-05-14T15:15:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.759+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43601592d0 con 0x7f4360155b70 2024-05-14T15:15:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.760+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4360050870 con 0x7f4360155b70 2024-05-14T15:15:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.761+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4358003f40 con 0x7f4360155b70 2024-05-14T15:15:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.762+0000 7f4357e00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43400762d0 0x7f43400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.763+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f4358097d50 con 0x7f4360155b70 2024-05-14T15:15:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.763+0000 7f435fe00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43400762d0 0x7f43400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:47.762 INFO:tasks.ceph.mds.b.smithi156.stderr:2024-05-14T15:15:47.763+0000 7f8982c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T15:15:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.764+0000 7f435fe00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43400762d0 0x7f43400787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4350000f60 tx=0x7f4350007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:47.768+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f435809b030 con 0x7f4360155b70 2024-05-14T15:15:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.025+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f436015dfd0 con 0x7f4360155b70 2024-05-14T15:15:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.501+0000 7f4357e00640 1 -- 172.21.15.2:0/2971085466 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f4358014030 con 0x7f4360155b70 2024-05-14T15:15:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:added data pool 4 to fsmap 2024-05-14T15:15:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43400762d0 msgr2=0x7f43400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43400762d0 0x7f43400787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4350000f60 tx=0x7f4350007c00 comp rx=0 tx=0).stop 2024-05-14T15:15:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 msgr2=0x7f4360159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 0x7f4360159db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f435800ccb0 tx=0x7f435800a5c0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 shutdown_connections 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43400762d0 0x7f43400787e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4360155b70 0x7f4360159db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43600d0ff0 0x7f43601479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 --2- 172.21.15.2:0/2971085466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f436006c6f0 0x7f43601470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 >> 172.21.15.2:0/2971085466 conn(0x7f43600ce230 msgr2=0x7f43600b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 shutdown_connections 2024-05-14T15:15:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.505+0000 7f4366a00640 1 -- 172.21.15.2:0/2971085466 wait complete. 2024-05-14T15:15:48.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:15:48.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.823+0000 7fa208200640 1 Processor -- start 2024-05-14T15:15:48.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.823+0000 7fa208200640 1 -- start start 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa208200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b7520 0x7fa2000b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa208200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2000b3780 0x7fa2000b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa208200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20015e8e0 con 0x7fa20015e4d0 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa208200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa20006e940 con 0x7fa2000b3780 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa208200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa20006c890 con 0x7fa2000b7520 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa205800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa20015e4d0 0x7fa2000b6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49894/0 (socket says 172.21.15.2:49894) 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.826+0000 7fa205800640 1 -- 172.21.15.2:0/3200043863 learned_addr learned my addr 172.21.15.2:0/3200043863 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa206200640 1 --2- 172.21.15.2:0/3200043863 >> v2:172.21.15.2:3300/0 conn(0x7fa2000b3780 0x7fa2000b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa204e00640 1 --2- 172.21.15.2:0/3200043863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b7520 0x7fa2000b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa1ffe00640 1 -- 172.21.15.2:0/3200043863 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796101743 0 0) 0x7fa20015e8e0 con 0x7fa20015e4d0 2024-05-14T15:15:48.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa1ffe00640 1 -- 172.21.15.2:0/3200043863 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1e8003520 con 0x7fa20015e4d0 2024-05-14T15:15:48.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa206200640 1 -- 172.21.15.2:0/3200043863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b7520 msgr2=0x7fa2000b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:48.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa206200640 1 --2- 172.21.15.2:0/3200043863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b7520 0x7fa2000b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa206200640 1 -- 172.21.15.2:0/3200043863 >> v1:172.21.15.2:6789/0 conn(0x7fa20015e4d0 legacy=0x7fa2000b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.827+0000 7fa206200640 1 -- 172.21.15.2:0/3200043863 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20006cb70 con 0x7fa2000b3780 2024-05-14T15:15:48.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.828+0000 7fa206200640 1 --2- 172.21.15.2:0/3200043863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2000b3780 0x7fa2000b3b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009d90 tx=0x7fa1f802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac64cad6e8f1652c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:48.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.829+0000 7fa1ffe00640 1 -- 172.21.15.2:0/3200043863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8007740 con 0x7fa2000b3780 2024-05-14T15:15:48.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.829+0000 7fa1ffe00640 1 -- 172.21.15.2:0/3200043863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f80078e0 con 0x7fa2000b3780 2024-05-14T15:15:48.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.829+0000 7fa1ffe00640 1 -- 172.21.15.2:0/3200043863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8007c90 con 0x7fa2000b3780 2024-05-14T15:15:48.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 -- 172.21.15.2:0/3200043863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2000b3780 msgr2=0x7fa2000b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 --2- 172.21.15.2:0/3200043863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2000b3780 0x7fa2000b3b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009d90 tx=0x7fa1f802a6f0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 -- 172.21.15.2:0/3200043863 shutdown_connections 2024-05-14T15:15:48.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 --2- 172.21.15.2:0/3200043863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2000b3780 0x7fa2000b3b90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 --2- 172.21.15.2:0/3200043863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b7520 0x7fa2000b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 -- 172.21.15.2:0/3200043863 >> 172.21.15.2:0/3200043863 conn(0x7fa200073f80 msgr2=0x7fa20009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:48.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 -- 172.21.15.2:0/3200043863 shutdown_connections 2024-05-14T15:15:48.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.830+0000 7fa208200640 1 -- 172.21.15.2:0/3200043863 wait complete. 2024-05-14T15:15:48.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.832+0000 7fa208200640 1 Processor -- start 2024-05-14T15:15:48.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.832+0000 7fa208200640 1 -- start start 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa208200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b3780 0x7fa2000ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa208200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa20015e4d0 0x7fa200155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa208200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 0x7fa2000d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa208200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa20006d410 con 0x7fa200156060 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa208200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa20006d130 con 0x7fa20015e4d0 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa208200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa2000ce710 con 0x7fa2000b3780 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa206200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 0x7fa2000d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa206200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 0x7fa2000d0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40896/0 (socket says 172.21.15.2:40896) 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.834+0000 7fa206200640 1 -- 172.21.15.2:0/1731460093 learned_addr learned my addr 172.21.15.2:0/1731460093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa204e00640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa20015e4d0 0x7fa200155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa205800640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b3780 0x7fa2000ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa206200640 1 -- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b3780 msgr2=0x7fa2000ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa206200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b3780 0x7fa2000ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa206200640 1 -- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa20015e4d0 msgr2=0x7fa200155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa206200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa20015e4d0 0x7fa200155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa206200640 1 -- 172.21.15.2:0/1731460093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2001e5440 con 0x7fa200156060 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa206200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 0x7fa2000d0c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009eb0 tx=0x7fa1f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.835+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8040070 con 0x7fa200156060 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.836+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f8031c40 con 0x7fa200156060 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.836+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8009450 con 0x7fa200156060 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.836+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2000cfc00 con 0x7fa200156060 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.836+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2000cfea0 con 0x7fa200156060 2024-05-14T15:15:48.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.837+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa200050870 con 0x7fa200156060 2024-05-14T15:15:48.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.838+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1f8003990 con 0x7fa200156060 2024-05-14T15:15:48.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.839+0000 7fa1fd600640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1e40762d0 0x7fa1e40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.839+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa1f80b8940 con 0x7fa200156060 2024-05-14T15:15:48.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.840+0000 7fa205800640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1e40762d0 0x7fa1e40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.841+0000 7fa205800640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1e40762d0 0x7fa1e40787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4007a60 tx=0x7fa1f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:48.845+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2000cfc00 con 0x7fa200156060 2024-05-14T15:15:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.100+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2000b4880 con 0x7fa200156060 2024-05-14T15:15:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.102+0000 7fa1fd600640 1 -- 172.21.15.2:0/1731460093 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5174 (secure 0 0 0) 0x7fa1f8081ed0 con 0x7fa200156060 2024-05-14T15:15:49.100 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:49.100 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:15:48.027443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:15:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.104+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1e40762d0 msgr2=0x7fa1e40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.104+0000 7fa208200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1e40762d0 0x7fa1e40787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4007a60 tx=0x7fa1f4009040 comp rx=0 tx=0).stop 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.104+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 msgr2=0x7fa2000d0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.104+0000 7fa208200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 0x7fa2000d0c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009eb0 tx=0x7fa1f8004a40 comp rx=0 tx=0).stop 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 shutdown_connections 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1e40762d0 0x7fa1e40787e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa20015e4d0 0x7fa200155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa200156060 0x7fa2000d0c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 --2- 172.21.15.2:0/1731460093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2000b3780 0x7fa2000ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 >> 172.21.15.2:0/1731460093 conn(0x7fa200073f80 msgr2=0x7fa20006fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 shutdown_connections 2024-05-14T15:15:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.105+0000 7fa208200640 1 -- 172.21.15.2:0/1731460093 wait complete. 2024-05-14T15:15:49.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:15:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.422+0000 7feed0c00640 1 Processor -- start 2024-05-14T15:15:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.422+0000 7feed0c00640 1 -- start start 2024-05-14T15:15:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.424+0000 7feed0c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc0b56a0 0x7feecc0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.424+0000 7feed0c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feecc06d700 0x7feecc06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.424+0000 7feed0c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feecc0b5ab0 con 0x7feecc15ca80 2024-05-14T15:15:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.424+0000 7feed0c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7feecc06e050 con 0x7feecc06d700 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.424+0000 7feed0c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7feecc0b0d10 con 0x7feecc0b56a0 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feecbe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feecc06d700 0x7feecc06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feec3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feecc15ca80 0x7feecc0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49896/0 (socket says 172.21.15.2:49896) 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feec3e00640 1 -- 172.21.15.2:0/1807314324 learned_addr learned my addr 172.21.15.2:0/1807314324 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feecb400640 1 --2- 172.21.15.2:0/1807314324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc0b56a0 0x7feecc0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feecbe00640 1 -- 172.21.15.2:0/1807314324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc0b56a0 msgr2=0x7feecc0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feecbe00640 1 --2- 172.21.15.2:0/1807314324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc0b56a0 0x7feecc0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feecbe00640 1 -- 172.21.15.2:0/1807314324 >> v1:172.21.15.2:6789/0 conn(0x7feecc15ca80 legacy=0x7feecc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.426+0000 7feecbe00640 1 -- 172.21.15.2:0/1807314324 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc0b0ff0 con 0x7feecc06d700 2024-05-14T15:15:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.425+0000 7feecaa00640 1 -- 172.21.15.2:0/1807314324 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736204291 0 0) 0x7feeb4001110 con 0x7feecc15ca80 2024-05-14T15:15:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.427+0000 7feecbe00640 1 --2- 172.21.15.2:0/1807314324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc06d700 0x7feecc06db10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feec4009d90 tx=0x7feec402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc365f0a3a5ca6c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.427+0000 7feecaa00640 1 -- 172.21.15.2:0/1807314324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4007740 con 0x7feecc06d700 2024-05-14T15:15:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.427+0000 7feecaa00640 1 -- 172.21.15.2:0/1807314324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec40078e0 con 0x7feecc06d700 2024-05-14T15:15:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.427+0000 7feecaa00640 1 -- 172.21.15.2:0/1807314324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4007cb0 con 0x7feecc06d700 2024-05-14T15:15:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 -- 172.21.15.2:0/1807314324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc06d700 msgr2=0x7feecc06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 --2- 172.21.15.2:0/1807314324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc06d700 0x7feecc06db10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feec4009d90 tx=0x7feec402a660 comp rx=0 tx=0).stop 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 -- 172.21.15.2:0/1807314324 shutdown_connections 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 --2- 172.21.15.2:0/1807314324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc06d700 0x7feecc06db10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 --2- 172.21.15.2:0/1807314324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc0b56a0 0x7feecc0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 -- 172.21.15.2:0/1807314324 >> 172.21.15.2:0/1807314324 conn(0x7feecc0732e0 msgr2=0x7feecc0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 -- 172.21.15.2:0/1807314324 shutdown_connections 2024-05-14T15:15:49.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.428+0000 7feed0c00640 1 -- 172.21.15.2:0/1807314324 wait complete. 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.430+0000 7feed0c00640 1 Processor -- start 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.430+0000 7feed0c00640 1 -- start start 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feed0c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc06d700 0x7feecc158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feed0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 0x7feecc15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feed0c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feecc15ca80 0x7feecc15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feed0c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0b5180 con 0x7feecc0b56a0 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feed0c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0b4ea0 con 0x7feecc15ca80 2024-05-14T15:15:49.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feed0c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7feecc15ce90 con 0x7feecc06d700 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feec3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 0x7feecc15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feec3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 0x7feecc15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40910/0 (socket says 172.21.15.2:40910) 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.432+0000 7feec3e00640 1 -- 172.21.15.2:0/581644849 learned_addr learned my addr 172.21.15.2:0/581644849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feecbe00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feecc15ca80 0x7feecc15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feecb400640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc06d700 0x7feecc158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3e00640 1 -- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc06d700 msgr2=0x7feecc158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3e00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc06d700 0x7feecc158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3e00640 1 -- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feecc15ca80 msgr2=0x7feecc15f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3e00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feecc15ca80 0x7feecc15f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3e00640 1 -- 172.21.15.2:0/581644849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc158540 con 0x7feecc0b56a0 2024-05-14T15:15:49.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3e00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 0x7feecc15a9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feeb400c390 tx=0x7feeb400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:49.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40074e0 con 0x7feecc0b56a0 2024-05-14T15:15:49.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb40047e0 con 0x7feecc0b56a0 2024-05-14T15:15:49.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc1f6a80 con 0x7feecc0b56a0 2024-05-14T15:15:49.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.433+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004bd0 con 0x7feecc0b56a0 2024-05-14T15:15:49.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.434+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc15b760 con 0x7feecc0b56a0 2024-05-14T15:15:49.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.435+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc0d0da0 con 0x7feecc0b56a0 2024-05-14T15:15:49.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.436+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feeb4011070 con 0x7feecc0b56a0 2024-05-14T15:15:49.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.438+0000 7feec3400640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feea80762d0 0x7feea80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.438+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feeb40975c0 con 0x7feecc0b56a0 2024-05-14T15:15:49.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.438+0000 7feecb400640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feea80762d0 0x7feea80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.440+0000 7feecb400640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feea80762d0 0x7feea80787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feebc009a30 tx=0x7feebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.443+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feecc158540 con 0x7feecc0b56a0 2024-05-14T15:15:49.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.659+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feecc074430 con 0x7feecc0b56a0 2024-05-14T15:15:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.663+0000 7feec3400640 1 -- 172.21.15.2:0/581644849 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7feecc0b5ab0 con 0x7feecc0b56a0 2024-05-14T15:15:49.661 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:49.662 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feea80762d0 msgr2=0x7feea80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feea80762d0 0x7feea80787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feebc009a30 tx=0x7feebc008040 comp rx=0 tx=0).stop 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 msgr2=0x7feecc15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 0x7feecc15a9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feeb400c390 tx=0x7feeb400c850 comp rx=0 tx=0).stop 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 shutdown_connections 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feea80762d0 0x7feea80787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feecc15ca80 0x7feecc15f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feecc0b56a0 0x7feecc15a9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 --2- 172.21.15.2:0/581644849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feecc06d700 0x7feecc158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 >> 172.21.15.2:0/581644849 conn(0x7feecc0732e0 msgr2=0x7feecc0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 shutdown_connections 2024-05-14T15:15:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.666+0000 7feed0c00640 1 -- 172.21.15.2:0/581644849 wait complete. 2024-05-14T15:15:49.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:15:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.975+0000 7f729d200640 1 Processor -- start 2024-05-14T15:15:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.975+0000 7f729d200640 1 -- start start 2024-05-14T15:15:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.978+0000 7f729d200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f729806d700 0x7f729806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.978+0000 7f729d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72980ae750 0x7f72980aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.978+0000 7f729d200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729806e050 con 0x7f72980d1050 2024-05-14T15:15:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.978+0000 7f729d200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f72981624e0 con 0x7f72980ae750 2024-05-14T15:15:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.978+0000 7f729d200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f72981618d0 con 0x7f729806d700 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72980ae750 0x7f72980aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72980ae750 0x7f72980aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44332/0 (socket says 172.21.15.2:44332) 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 -- 172.21.15.2:0/2866207089 learned_addr learned my addr 172.21.15.2:0/2866207089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7296a00640 1 --2- 172.21.15.2:0/2866207089 >> v2:172.21.15.156:3300/0 conn(0x7f729806d700 0x7f729806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 -- 172.21.15.2:0/2866207089 >> v2:172.21.15.156:3300/0 conn(0x7f729806d700 msgr2=0x7f729806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 --2- 172.21.15.2:0/2866207089 >> v2:172.21.15.156:3300/0 conn(0x7f729806d700 0x7f729806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 -- 172.21.15.2:0/2866207089 >> v1:172.21.15.156:6789/0 conn(0x7f72980d1050 legacy=0x7f7298070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.979+0000 7f7297e00640 1 -- 172.21.15.2:0/2866207089 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7298161bb0 con 0x7f72980ae750 2024-05-14T15:15:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.980+0000 7f7297e00640 1 --2- 172.21.15.2:0/2866207089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980ae750 0x7f72980aeb60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f729809faa0 tx=0x7f729002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c6e13ebcc1119f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.981+0000 7f7296000640 1 -- 172.21.15.2:0/2866207089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290036070 con 0x7f72980ae750 2024-05-14T15:15:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.981+0000 7f7296000640 1 -- 172.21.15.2:0/2866207089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7290031600 con 0x7f72980ae750 2024-05-14T15:15:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.981+0000 7f7296000640 1 -- 172.21.15.2:0/2866207089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72900319d0 con 0x7f72980ae750 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.981+0000 7f729d200640 1 -- 172.21.15.2:0/2866207089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980ae750 msgr2=0x7f72980aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.981+0000 7f729d200640 1 --2- 172.21.15.2:0/2866207089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980ae750 0x7f72980aeb60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f729809faa0 tx=0x7f729002a730 comp rx=0 tx=0).stop 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.982+0000 7f729d200640 1 -- 172.21.15.2:0/2866207089 shutdown_connections 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.982+0000 7f729d200640 1 --2- 172.21.15.2:0/2866207089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980ae750 0x7f72980aeb60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.982+0000 7f729d200640 1 --2- 172.21.15.2:0/2866207089 >> v2:172.21.15.156:3300/0 conn(0x7f729806d700 0x7f729806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.982+0000 7f729d200640 1 -- 172.21.15.2:0/2866207089 >> 172.21.15.2:0/2866207089 conn(0x7f72980732e0 msgr2=0x7f72980736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.982+0000 7f729d200640 1 -- 172.21.15.2:0/2866207089 shutdown_connections 2024-05-14T15:15:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.982+0000 7f729d200640 1 -- 172.21.15.2:0/2866207089 wait complete. 2024-05-14T15:15:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.984+0000 7f729d200640 1 Processor -- start 2024-05-14T15:15:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.984+0000 7f729d200640 1 -- start start 2024-05-14T15:15:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f729d200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f729806d700 0x7f7298140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f729d200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72980ae750 0x7f729814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f729d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980d1050 0x7f7298147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f729d200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7298071050 con 0x7f72980d1050 2024-05-14T15:15:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f729d200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7298162170 con 0x7f72980ae750 2024-05-14T15:15:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f729d200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f729815f110 con 0x7f729806d700 2024-05-14T15:15:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.986+0000 7f7296a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72980ae750 0x7f729814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f729806d700 0x7f7298140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980d1050 0x7f7298147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7296a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72980ae750 0x7f729814fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:36698/0 (socket says 172.21.15.2:36698) 2024-05-14T15:15:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7296a00640 1 -- 172.21.15.2:0/822612444 learned_addr learned my addr 172.21.15.2:0/822612444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 -- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f729806d700 msgr2=0x7f7298140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f729806d700 0x7f7298140f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 -- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72980ae750 msgr2=0x7f729814fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72980ae750 0x7f729814fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 -- 172.21.15.2:0/822612444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7298144770 con 0x7f72980d1050 2024-05-14T15:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.987+0000 7f7297e00640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980d1050 0x7f7298147340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7298069e40 tx=0x7f7290004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.988+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729003f020 con 0x7f72980d1050 2024-05-14T15:15:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.988+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7290037040 con 0x7f72980d1050 2024-05-14T15:15:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.988+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290036070 con 0x7f72980d1050 2024-05-14T15:15:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.988+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72981439b0 con 0x7f72980d1050 2024-05-14T15:15:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.988+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7298143f70 con 0x7f72980d1050 2024-05-14T15:15:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.989+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7298150500 con 0x7f72980d1050 2024-05-14T15:15:49.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.991+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7290042020 con 0x7f72980d1050 2024-05-14T15:15:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.992+0000 7f728f400640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72740762d0 0x7f72740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.992+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f72900b7b00 con 0x7f72980d1050 2024-05-14T15:15:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.992+0000 7f7297400640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72740762d0 0x7f72740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:49.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.994+0000 7f7297400640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72740762d0 0x7f72740787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7298074f20 tx=0x7f7288009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:49.997+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7290049030 con 0x7f72980d1050 2024-05-14T15:15:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.211+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7298050870 con 0x7f72980d1050 2024-05-14T15:15:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.214+0000 7f728f400640 1 -- 172.21.15.2:0/822612444 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7f7290089100 con 0x7f72980d1050 2024-05-14T15:15:50.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:50.213 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.217+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72740762d0 msgr2=0x7f72740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.217+0000 7f729d200640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72740762d0 0x7f72740787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7298074f20 tx=0x7f7288009040 comp rx=0 tx=0).stop 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.217+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980d1050 msgr2=0x7f7298147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.217+0000 7f729d200640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980d1050 0x7f7298147340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7298069e40 tx=0x7f7290004a40 comp rx=0 tx=0).stop 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 shutdown_connections 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72740762d0 0x7f72740787e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72980ae750 0x7f729814fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72980d1050 0x7f7298147340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 --2- 172.21.15.2:0/822612444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f729806d700 0x7f7298140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 >> 172.21.15.2:0/822612444 conn(0x7f72980732e0 msgr2=0x7f72980b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 shutdown_connections 2024-05-14T15:15:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.218+0000 7f729d200640 1 -- 172.21.15.2:0/822612444 wait complete. 2024-05-14T15:15:50.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:15:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.551+0000 7f7fe8a00640 1 Processor -- start 2024-05-14T15:15:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.551+0000 7f7fe8a00640 1 -- start start 2024-05-14T15:15:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fe8a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7fe40b1b80 0x7f7fe40cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fe8a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7fe406e7a0 0x7f7fe40d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fe8a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe40b48e0 con 0x7f7fe40d0230 2024-05-14T15:15:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fe8a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe40d2400 con 0x7f7fe40b1b80 2024-05-14T15:15:50.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fe8a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe40b2180 con 0x7f7fe406e7a0 2024-05-14T15:15:50.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fdbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7fe40d0230 0x7f7fe406e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43606/0 (socket says 172.21.15.2:43606) 2024-05-14T15:15:50.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fdbe00640 1 -- 172.21.15.2:0/1863040966 learned_addr learned my addr 172.21.15.2:0/1863040966 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:50.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.554+0000 7f7fe3400640 1 --2- 172.21.15.2:0/1863040966 >> v2:172.21.15.2:3300/0 conn(0x7f7fe40b1b80 0x7f7fe40cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe3e00640 1 --2- 172.21.15.2:0/1863040966 >> v2:172.21.15.156:3300/0 conn(0x7f7fe406e7a0 0x7f7fe40d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe2a00640 1 -- 172.21.15.2:0/1863040966 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692490742 0 0) 0x7f7fe40b48e0 con 0x7f7fe40d0230 2024-05-14T15:15:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe3400640 1 -- 172.21.15.2:0/1863040966 >> v2:172.21.15.156:3300/0 conn(0x7f7fe406e7a0 msgr2=0x7f7fe40d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe3400640 1 --2- 172.21.15.2:0/1863040966 >> v2:172.21.15.156:3300/0 conn(0x7f7fe406e7a0 0x7f7fe40d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe3400640 1 -- 172.21.15.2:0/1863040966 >> v1:172.21.15.2:6789/0 conn(0x7f7fe40d0230 legacy=0x7f7fe406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe3400640 1 -- 172.21.15.2:0/1863040966 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe40b2460 con 0x7f7fe40b1b80 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.555+0000 7f7fe3e00640 1 --2- 172.21.15.2:0/1863040966 >> v2:172.21.15.156:3300/0 conn(0x7f7fe406e7a0 0x7f7fe40d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.556+0000 7f7fe3400640 1 --2- 172.21.15.2:0/1863040966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe40cfba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40ccc40 tx=0x7f7fd402c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c137e99cf6b7f36b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.556+0000 7f7fe2a00640 1 -- 172.21.15.2:0/1863040966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4039070 con 0x7f7fe40b1b80 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.556+0000 7f7fe2a00640 1 -- 172.21.15.2:0/1863040966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd4034640 con 0x7f7fe40b1b80 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.556+0000 7f7fe2a00640 1 -- 172.21.15.2:0/1863040966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4034a10 con 0x7f7fe40b1b80 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1863040966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 msgr2=0x7f7fe40cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1863040966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe40cfba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40ccc40 tx=0x7f7fd402c3b0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1863040966 shutdown_connections 2024-05-14T15:15:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1863040966 >> v2:172.21.15.156:3300/0 conn(0x7f7fe406e7a0 0x7f7fe40d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1863040966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe40cfba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1863040966 >> 172.21.15.2:0/1863040966 conn(0x7f7fe409b410 msgr2=0x7f7fe409b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1863040966 shutdown_connections 2024-05-14T15:15:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.557+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1863040966 wait complete. 2024-05-14T15:15:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.560+0000 7f7fe8a00640 1 Processor -- start 2024-05-14T15:15:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.560+0000 7f7fe8a00640 1 -- start start 2024-05-14T15:15:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.561+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe4159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.561+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fe40d0230 0x7f7fe414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7fe40b1330 0x7f7fe40d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe406ed80 con 0x7f7fe40b1b80 2024-05-14T15:15:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe40b4550 con 0x7f7fe40d0230 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe406ef00 con 0x7f7fe40b1330 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe4159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe4159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44374/0 (socket says 172.21.15.2:44374) 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 -- 172.21.15.2:0/1714768772 learned_addr learned my addr 172.21.15.2:0/1714768772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fdbe00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fe40d0230 0x7f7fe414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 -- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7fe40b1330 msgr2=0x7f7fe40d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3e00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7fe40b1330 0x7f7fe40d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7fe40b1330 0x7f7fe40d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 -- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fe40d0230 msgr2=0x7f7fe414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fe40d0230 0x7f7fe414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fe3400640 1 -- 172.21.15.2:0/1714768772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe415fe20 con 0x7f7fe40b1b80 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.562+0000 7f7fdbe00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fe40d0230 0x7f7fe414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.563+0000 7f7fe3400640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe4159570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009890 tx=0x7f7fd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.563+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4039070 con 0x7f7fe40b1b80 2024-05-14T15:15:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.563+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd4032980 con 0x7f7fe40b1b80 2024-05-14T15:15:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.563+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe414f350 con 0x7f7fe40b1b80 2024-05-14T15:15:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.563+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4032d50 con 0x7f7fe40b1b80 2024-05-14T15:15:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.563+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe415d6f0 con 0x7f7fe40b1b80 2024-05-14T15:15:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.564+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe4050870 con 0x7f7fe40b1b80 2024-05-14T15:15:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.566+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fd403f440 con 0x7f7fe40b1b80 2024-05-14T15:15:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.567+0000 7f7fdb400640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7fc00762d0 0x7f7fc00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.567+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7fd40b8600 con 0x7f7fe40b1b80 2024-05-14T15:15:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.568+0000 7f7fdbe00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7fc00762d0 0x7f7fc00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.569+0000 7f7fdbe00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7fc00762d0 0x7f7fc00787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40d1cb0 tx=0x7f7fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.572+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7fd4081af0 con 0x7f7fe40b1b80 2024-05-14T15:15:50.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.822+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe40cf220 con 0x7f7fe40b1b80 2024-05-14T15:15:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.823+0000 7f7fdb400640 1 -- 172.21.15.2:0/1714768772 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5174 (secure 0 0 0) 0x7f7fd40813f0 con 0x7f7fe40b1b80 2024-05-14T15:15:50.821 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:15:48.027443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:15:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7fc00762d0 msgr2=0x7f7fc00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7fc00762d0 0x7f7fc00787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40d1cb0 tx=0x7f7fcc009040 comp rx=0 tx=0).stop 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 msgr2=0x7f7fe4159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe4159570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009890 tx=0x7f7fd40046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 shutdown_connections 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7fc00762d0 0x7f7fc00787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fe40d0230 0x7f7fe414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7fe40b1330 0x7f7fe40d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 --2- 172.21.15.2:0/1714768772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe40b1b80 0x7f7fe4159570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.825+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 >> 172.21.15.2:0/1714768772 conn(0x7f7fe409b410 msgr2=0x7f7fe40d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.826+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 shutdown_connections 2024-05-14T15:15:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:50.826+0000 7f7fe8a00640 1 -- 172.21.15.2:0/1714768772 wait complete. 2024-05-14T15:15:50.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:15:51.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.119+0000 7fc749200640 1 Processor -- start 2024-05-14T15:15:51.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.119+0000 7fc749200640 1 -- start start 2024-05-14T15:15:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc749200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc7440ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc749200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7440b7410 0x7fc7440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc749200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7440b7d60 con 0x7fc74406ede0 2024-05-14T15:15:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc749200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc74415e4e0 con 0x7fc7440b7410 2024-05-14T15:15:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc749200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc7440ce730 con 0x7fc74406cf60 2024-05-14T15:15:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc743400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc74406ede0 0x7fc74406f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43612/0 (socket says 172.21.15.2:43612) 2024-05-14T15:15:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc743400640 1 -- 172.21.15.2:0/1236705278 learned_addr learned my addr 172.21.15.2:0/1236705278 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.121+0000 7fc743e00640 1 --2- 172.21.15.2:0/1236705278 >> v2:172.21.15.2:3300/0 conn(0x7fc7440b7410 0x7fc7440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc742a00640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc7440ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc742000640 1 -- 172.21.15.2:0/1236705278 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940196566 0 0) 0x7fc72c001110 con 0x7fc74406ede0 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc742000640 1 -- 172.21.15.2:0/1236705278 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc728003520 con 0x7fc74406ede0 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc743e00640 1 -- 172.21.15.2:0/1236705278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 msgr2=0x7fc7440ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc743e00640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc7440ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc743e00640 1 -- 172.21.15.2:0/1236705278 >> v1:172.21.15.2:6789/0 conn(0x7fc74406ede0 legacy=0x7fc74406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc743e00640 1 -- 172.21.15.2:0/1236705278 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7440cea10 con 0x7fc7440b7410 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.122+0000 7fc742a00640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc7440ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:51.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.123+0000 7fc743e00640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc7440b7820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0097a0 tx=0x7fc73c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4a109971e7ba9e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.123+0000 7fc742000640 1 -- 172.21.15.2:0/1236705278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c037070 con 0x7fc7440b7410 2024-05-14T15:15:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.123+0000 7fc742000640 1 -- 172.21.15.2:0/1236705278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73c032440 con 0x7fc7440b7410 2024-05-14T15:15:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.123+0000 7fc742000640 1 -- 172.21.15.2:0/1236705278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0327f0 con 0x7fc7440b7410 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 -- 172.21.15.2:0/1236705278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 msgr2=0x7fc7440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc7440b7820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0097a0 tx=0x7fc73c02a180 comp rx=0 tx=0).stop 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 -- 172.21.15.2:0/1236705278 shutdown_connections 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc7440b7820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 --2- 172.21.15.2:0/1236705278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc7440ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 -- 172.21.15.2:0/1236705278 >> 172.21.15.2:0/1236705278 conn(0x7fc74409b410 msgr2=0x7fc74409b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.124+0000 7fc749200640 1 -- 172.21.15.2:0/1236705278 shutdown_connections 2024-05-14T15:15:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.125+0000 7fc749200640 1 -- 172.21.15.2:0/1236705278 wait complete. 2024-05-14T15:15:51.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.127+0000 7fc749200640 1 Processor -- start 2024-05-14T15:15:51.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.127+0000 7fc749200640 1 -- start start 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.128+0000 7fc749200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc74415e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.128+0000 7fc749200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74406ede0 0x7fc7441552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc749200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc744153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc749200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7440b2470 con 0x7fc7440b7410 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc749200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc7440b1f50 con 0x7fc74406ede0 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc749200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc7440b25f0 con 0x7fc74406cf60 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc744153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc744153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44380/0 (socket says 172.21.15.2:44380) 2024-05-14T15:15:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 -- 172.21.15.2:0/521924941 learned_addr learned my addr 172.21.15.2:0/521924941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743400640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc74415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 -- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 msgr2=0x7fc74415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc742a00640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74406ede0 0x7fc7441552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc74415e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 -- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74406ede0 msgr2=0x7fc7441552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74406ede0 0x7fc7441552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.129+0000 7fc743e00640 1 -- 172.21.15.2:0/521924941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc744154300 con 0x7fc7440b7410 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.130+0000 7fc743e00640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc744153440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc73c035040 tx=0x7fc73c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.130+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c037040 con 0x7fc7440b7410 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.130+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73c042070 con 0x7fc7440b7410 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.130+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c032830 con 0x7fc7440b7410 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.130+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7441571f0 con 0x7fc7440b7410 2024-05-14T15:15:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.130+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc744154ad0 con 0x7fc7440b7410 2024-05-14T15:15:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.131+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc744156f60 con 0x7fc7440b7410 2024-05-14T15:15:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.132+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc73c0329d0 con 0x7fc7440b7410 2024-05-14T15:15:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.133+0000 7fc73b400640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc720076300 0x7fc720078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.133+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc73c0b8150 con 0x7fc7440b7410 2024-05-14T15:15:51.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.134+0000 7fc743400640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc720076300 0x7fc720078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.135+0000 7fc743400640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc720076300 0x7fc720078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc72c005880 tx=0x7fc72c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.138+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc73c0044a0 con 0x7fc7440b7410 2024-05-14T15:15:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.348+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7441545e0 con 0x7fc7440b7410 2024-05-14T15:15:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.351+0000 7fc73b400640 1 -- 172.21.15.2:0/521924941 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7fc73c0816d0 con 0x7fc7440b7410 2024-05-14T15:15:51.350 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:51.350 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:15:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc720076300 msgr2=0x7fc720078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc720076300 0x7fc720078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc72c005880 tx=0x7fc72c009040 comp rx=0 tx=0).stop 2024-05-14T15:15:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 msgr2=0x7fc744153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc744153440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc73c035040 tx=0x7fc73c0046c0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 shutdown_connections 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc720076300 0x7fc720078810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74406ede0 0x7fc7441552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7440b7410 0x7fc744153440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 --2- 172.21.15.2:0/521924941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74406cf60 0x7fc74415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 >> 172.21.15.2:0/521924941 conn(0x7fc74409b410 msgr2=0x7fc744068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 shutdown_connections 2024-05-14T15:15:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:51.354+0000 7fc749200640 1 -- 172.21.15.2:0/521924941 wait complete. 2024-05-14T15:15:51.781 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T15:15:42.977951+0000', 'modified': '2024-05-14T15:15:48.027443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6837/218190176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 218190176}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 218190176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4273, 'qdb_cluster': [4273]} 2024-05-14T15:15:51.781 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T15:15:51.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-14T15:15:52.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.078+0000 7f577a000640 1 Processor -- start 2024-05-14T15:15:52.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.078+0000 7f577a000640 1 -- start start 2024-05-14T15:15:52.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f577a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5774160720 0x7f57740b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f577a000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f577415d760 0x7f577415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f577a000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5774160c90 con 0x7f57740cdd80 2024-05-14T15:15:52.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f577a000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f577415ab00 con 0x7f5774160720 2024-05-14T15:15:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f577a000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5774160f70 con 0x7f577415d760 2024-05-14T15:15:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f5778c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5774160720 0x7f57740b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f5778c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5774160720 0x7f57740b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44390/0 (socket says 172.21.15.2:44390) 2024-05-14T15:15:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.080+0000 7f5778c00640 1 -- 172.21.15.2:0/867802816 learned_addr learned my addr 172.21.15.2:0/867802816 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.081+0000 7f5779600640 1 --2- 172.21.15.2:0/867802816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f577415d760 0x7f577415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.081+0000 7f5778c00640 1 -- 172.21.15.2:0/867802816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f577415d760 msgr2=0x7f577415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.081+0000 7f5778c00640 1 --2- 172.21.15.2:0/867802816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f577415d760 0x7f577415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.081+0000 7f5778c00640 1 -- 172.21.15.2:0/867802816 >> v1:172.21.15.156:6789/0 conn(0x7f57740cdd80 legacy=0x7f57740b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.081+0000 7f5778c00640 1 -- 172.21.15.2:0/867802816 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5774161250 con 0x7f5774160720 2024-05-14T15:15:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.082+0000 7f5778c00640 1 --2- 172.21.15.2:0/867802816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5774160720 0x7f57740b6530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5768009870 tx=0x7f576802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c22a138dabf676 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.082+0000 7f5773400640 1 -- 172.21.15.2:0/867802816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768037070 con 0x7f5774160720 2024-05-14T15:15:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.082+0000 7f5773400640 1 -- 172.21.15.2:0/867802816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5768032440 con 0x7f5774160720 2024-05-14T15:15:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.082+0000 7f5773400640 1 -- 172.21.15.2:0/867802816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768032810 con 0x7f5774160720 2024-05-14T15:15:52.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 -- 172.21.15.2:0/867802816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5774160720 msgr2=0x7f57740b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 --2- 172.21.15.2:0/867802816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5774160720 0x7f57740b6530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5768009870 tx=0x7f576802a1c0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 -- 172.21.15.2:0/867802816 shutdown_connections 2024-05-14T15:15:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 --2- 172.21.15.2:0/867802816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f577415d760 0x7f577415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 --2- 172.21.15.2:0/867802816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5774160720 0x7f57740b6530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 -- 172.21.15.2:0/867802816 >> 172.21.15.2:0/867802816 conn(0x7f57740739a0 msgr2=0x7f5774073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 -- 172.21.15.2:0/867802816 shutdown_connections 2024-05-14T15:15:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.083+0000 7f577a000640 1 -- 172.21.15.2:0/867802816 wait complete. 2024-05-14T15:15:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.086+0000 7f577a000640 1 Processor -- start 2024-05-14T15:15:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.086+0000 7f577a000640 1 -- start start 2024-05-14T15:15:52.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.087+0000 7f577a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57740cdd80 0x7f57741f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.087+0000 7f577a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 0x7f57740b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.087+0000 7f577a000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5774160720 0x7f57740b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.087+0000 7f577a000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57740b6a70 con 0x7f577415d760 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.087+0000 7f577a000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5774161530 con 0x7f57740cdd80 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.087+0000 7f577a000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f57740b4d80 con 0x7f5774160720 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 0x7f57740b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 0x7f57740b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44396/0 (socket says 172.21.15.2:44396) 2024-05-14T15:15:52.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 -- 172.21.15.2:0/3976721401 learned_addr learned my addr 172.21.15.2:0/3976721401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5779600640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5774160720 0x7f57740b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 -- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5774160720 msgr2=0x7f57740b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5774160720 0x7f57740b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 -- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57740cdd80 msgr2=0x7f57741f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5778c00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57740cdd80 0x7f57741f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57740cdd80 0x7f57741f6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.088+0000 7f5773e00640 1 -- 172.21.15.2:0/3976721401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5774156bd0 con 0x7f577415d760 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.089+0000 7f5773e00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 0x7f57740b5090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f576000b3f0 tx=0x7f576000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.089+0000 7f5770c00640 1 -- 172.21.15.2:0/3976721401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760015020 con 0x7f577415d760 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.089+0000 7f5770c00640 1 -- 172.21.15.2:0/3976721401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5760011830 con 0x7f577415d760 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.089+0000 7f5770c00640 1 -- 172.21.15.2:0/3976721401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760011c20 con 0x7f577415d760 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.089+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57741589d0 con 0x7f577415d760 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.089+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5774158f90 con 0x7f577415d760 2024-05-14T15:15:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.092+0000 7f5770c00640 1 -- 172.21.15.2:0/3976721401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5760018020 con 0x7f577415d760 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.093+0000 7f5770c00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5754076300 0x7f5754078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.093+0000 7f5770c00640 1 -- 172.21.15.2:0/3976721401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5760097560 con 0x7f577415d760 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.093+0000 7f5782639740 1 Processor -- start 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.093+0000 7f5782639740 1 -- start start 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.093+0000 7f5778c00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5754076300 0x7f5754078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5754076300 0x7f5754078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5768034000 tx=0x7f576802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5782639740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aae6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167aaea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab16530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5782639740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56167aa4f790 con 0x56167a749270 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56167a9f4f20 con 0x56167a728590 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x56167aa4b750 con 0x56167a7203b0 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aae6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aae6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44400/0 (socket says 172.21.15.2:44400) 2024-05-14T15:15:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 -- 172.21.15.2:0/249925286 learned_addr learned my addr 172.21.15.2:0/249925286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5773e00640 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167aaea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5779600640 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab16530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 -- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 msgr2=0x56167aaea050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167aaea050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 -- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 msgr2=0x56167ab16530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab16530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.095+0000 7f5778c00640 1 -- 172.21.15.2:0/249925286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167a7612d0 con 0x56167a749270 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.096+0000 7f5778c00640 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aae6610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5768009960 tx=0x7f576802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288599d314561cdb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.096+0000 7f5765200640 1 -- 172.21.15.2:0/249925286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768037040 con 0x56167a749270 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.096+0000 7f5765200640 1 -- 172.21.15.2:0/249925286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576804c070 con 0x56167a749270 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.096+0000 7f5765200640 1 -- 172.21.15.2:0/249925286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576803c660 con 0x56167a749270 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 -- 172.21.15.2:0/249925286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 msgr2=0x56167aae6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aae6610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5768009960 tx=0x7f576802c000 comp rx=0 tx=0).stop 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 -- 172.21.15.2:0/249925286 shutdown_connections 2024-05-14T15:15:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab16530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167aaea050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 --2- 172.21.15.2:0/249925286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aae6610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 -- 172.21.15.2:0/249925286 >> 172.21.15.2:0/249925286 conn(0x56167a73d3c0 msgr2=0x56167aaebbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 -- 172.21.15.2:0/249925286 shutdown_connections 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.097+0000 7f5782639740 1 -- 172.21.15.2:0/249925286 wait complete. 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.098+0000 7f5782639740 1 -- start start 2024-05-14T15:15:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.098+0000 7f5782639740 1 Processor -- start 2024-05-14T15:15:52.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a7203b0 0x56167ab18650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a728590 0x56167ab2b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167ab11970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56167ab13fa0 con 0x56167a749270 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56167aa089c0 con 0x56167a7203b0 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x56167aae6b50 con 0x56167a728590 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5782639740 10 client.0 _ll_register_callbacks cb 0x56167a9d5120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5779600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167ab11970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.100+0000 7f5779600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167ab11970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44404/0 (socket says 172.21.15.2:44404) 2024-05-14T15:15:52.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 -- 172.21.15.2:0/3739853904 learned_addr learned my addr 172.21.15.2:0/3739853904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5773e00640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a728590 0x56167ab2b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5778c00640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a7203b0 0x56167ab18650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 -- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a728590 msgr2=0x56167ab2b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a728590 0x56167ab2b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 -- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a7203b0 msgr2=0x56167ab18650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a7203b0 0x56167ab18650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 -- 172.21.15.2:0/3739853904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56167a82b6b0 con 0x56167a749270 2024-05-14T15:15:52.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5773e00640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a728590 0x56167ab2b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5779600640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167ab11970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f576c007a00 tx=0x7f576c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505cb0afa9363a42 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.101+0000 7f5759600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5759600640 1 -- 172.21.15.2:0/3739853904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c011a80 con 0x56167a749270 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5759600640 1 -- 172.21.15.2:0/3739853904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f576c011c20 con 0x56167a749270 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576804c070 con 0x56167a749270 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5759600640 1 -- 172.21.15.2:0/3739853904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f576c023050 con 0x56167a749270 2024-05-14T15:15:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 10 client.4365 fetch_fsmap learned FSMap version 6 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56167ab18c90 con 0x56167a749270 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5759600640 1 -- 172.21.15.2:0/3739853904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576804c070 con 0x56167a749270 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5759600640 1 -- 172.21.15.2:0/3739853904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f576c026020 con 0x56167a749270 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 10 client.4365 fetch_fsmap finished waiting for FSMap version 6 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 10 client.4365 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 20 client.4365 populate_metadata read hostname 'smithi002' 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167a707e40 0x56167ab17730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 4 client.4365 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.102+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 --> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56167aa5d3a0 con 0x56167a707e40 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.103+0000 7f5778c00640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167a707e40 0x56167ab17730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.104+0000 7f5778c00640 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167a707e40 0x56167ab17730 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c42dcbc6255751 server_cookie=7af9ed2a709d142c in_seq=0 out_seq=0 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.104+0000 7f5759600640 10 client.4365 ms_handle_connect on v2:172.21.15.156:6836/218190176 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5759600640 1 -- 172.21.15.2:0/3739853904 <== mds.0 v2:172.21.15.156:6836/218190176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56167aa5d3a0 con 0x56167a707e40 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5759600640 10 client.4365 handle_command_reply: tid=0 2024-05-14T15:15:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5782639740 1 client.4365 shutdown 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 msgr2=0x56167ab11970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5782639740 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167ab11970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f576c007a00 tx=0x7f576c007ec0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 shutdown_connections 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.106+0000 7f5782639740 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167a707e40 0x56167ab17730 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167ab11970 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a728590 0x56167ab2b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 1 --2- 172.21.15.2:0/3739853904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a7203b0 0x56167ab18650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 >> 172.21.15.2:0/3739853904 conn(0x56167a73d3c0 msgr2=0x56167ab16530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5759600640 0 client.4365 ms_handle_reset on v2:172.21.15.156:6836/218190176 2024-05-14T15:15:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 shutdown_connections 2024-05-14T15:15:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 1 -- 172.21.15.2:0/3739853904 wait complete. 2024-05-14T15:15:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.107+0000 7f5782639740 20 client.4365 trim_cache size 0 max 16384 2024-05-14T15:15:52.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.128+0000 7f5782639740 1 Processor -- start 2024-05-14T15:15:52.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.128+0000 7f5782639740 1 -- start start 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab3f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167aaea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5782639740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aaea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5782639740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5774203060 con 0x56167a749270 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f57742023f0 con 0x56167a728590 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5774202a40 con 0x56167a7203b0 2024-05-14T15:15:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5779600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aaea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5779600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aaea590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44406/0 (socket says 172.21.15.2:44406) 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5779600640 1 -- 172.21.15.2:0/3924433806 learned_addr learned my addr 172.21.15.2:0/3924433806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5778c00640 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab3f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.130+0000 7f5773e00640 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167aaea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f5779600640 1 -- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 msgr2=0x56167ab3f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f5779600640 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab3f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f5779600640 1 -- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 msgr2=0x56167aaea050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f5779600640 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167aaea050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f5779600640 1 -- 172.21.15.2:0/3924433806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ab18950 con 0x56167a749270 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f5779600640 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aaea590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f576c0094c0 tx=0x7f576c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6483206ba78010eb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f575be00640 1 -- 172.21.15.2:0/3924433806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c011c80 con 0x56167a749270 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f575be00640 1 -- 172.21.15.2:0/3924433806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c02b070 con 0x56167a749270 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.131+0000 7f575be00640 1 -- 172.21.15.2:0/3924433806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c01e5d0 con 0x56167a749270 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 -- 172.21.15.2:0/3924433806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 msgr2=0x56167aaea590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aaea590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f576c0094c0 tx=0x7f576c00f000 comp rx=0 tx=0).stop 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 -- 172.21.15.2:0/3924433806 shutdown_connections 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167aaea050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167aaea590 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 --2- 172.21.15.2:0/3924433806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab3f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 -- 172.21.15.2:0/3924433806 >> 172.21.15.2:0/3924433806 conn(0x56167a73d3c0 msgr2=0x56167ab16530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 -- 172.21.15.2:0/3924433806 shutdown_connections 2024-05-14T15:15:52.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.132+0000 7f5782639740 1 -- 172.21.15.2:0/3924433806 wait complete. 2024-05-14T15:15:52.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.133+0000 7f5782639740 1 -- start start 2024-05-14T15:15:52.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.133+0000 7f5782639740 1 Processor -- start 2024-05-14T15:15:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab26cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167abadf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56167ab11eb0 con 0x56167a749270 2024-05-14T15:15:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56167ab107d0 con 0x56167a728590 2024-05-14T15:15:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x56167ab296a0 con 0x56167a7203b0 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5782639740 10 client.0 _ll_register_callbacks cb 0x7f576c0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5779600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167abadf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5779600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167abadf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44410/0 (socket says 172.21.15.2:44410) 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.135+0000 7f5779600640 1 -- 172.21.15.2:0/2467232280 learned_addr learned my addr 172.21.15.2:0/2467232280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5773e00640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab26cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5778c00640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5779600640 1 -- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 msgr2=0x56167ab183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5779600640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab183c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5779600640 1 -- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 msgr2=0x56167ab26cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5779600640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab26cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5779600640 1 -- 172.21.15.2:0/2467232280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56167ab16fc0 con 0x56167a749270 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5778c00640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5779600640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167abadf00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f576c012ef0 tx=0x7f576c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a512f3486d7b65 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.136+0000 7f5759600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5759600640 1 -- 172.21.15.2:0/2467232280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c01e7a0 con 0x56167a749270 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5759600640 1 -- 172.21.15.2:0/2467232280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f576c01e940 con 0x56167a749270 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576c02b070 con 0x56167a749270 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5759600640 1 -- 172.21.15.2:0/2467232280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f576c01eb60 con 0x56167a749270 2024-05-14T15:15:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5782639740 10 client.4371 fetch_fsmap learned FSMap version 6 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56167ab274c0 con 0x56167a749270 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5759600640 1 -- 172.21.15.2:0/2467232280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c02b070 con 0x56167a749270 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5759600640 1 -- 172.21.15.2:0/2467232280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f576c037070 con 0x56167a749270 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5782639740 10 client.4371 fetch_fsmap finished waiting for FSMap version 6 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5782639740 10 client.4371 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.137+0000 7f5782639740 20 client.4371 populate_metadata read hostname 'smithi002' 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.138+0000 7f5782639740 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167ab10b80 0x56167ab34820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.138+0000 7f5782639740 4 client.4371 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:15:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.138+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 --> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] -- command(tid 0: {"prefix": "status"}) -- 0x56167ab2db10 con 0x56167ab10b80 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.138+0000 7f5778c00640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167ab10b80 0x56167ab34820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.139+0000 7f5778c00640 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167ab10b80 0x56167ab34820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1361ac6095a65e9 server_cookie=314b3067b981aa47 in_seq=0 out_seq=0 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.139+0000 7f5759600640 10 client.4371 ms_handle_connect on v2:172.21.15.156:6836/218190176 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5759600640 1 -- 172.21.15.2:0/2467232280 <== mds.0 v2:172.21.15.156:6836/218190176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56167ab2db10 con 0x56167ab10b80 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5759600640 10 client.4371 handle_command_reply: tid=0 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 client.4371 shutdown 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 msgr2=0x56167abadf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167abadf00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f576c012ef0 tx=0x7f576c004a40 comp rx=0 tx=0).stop 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 shutdown_connections 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56167ab10b80 0x56167ab34820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56167a728590 0x56167ab26cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56167a749270 0x56167abadf00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 --2- 172.21.15.2:0/2467232280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56167a7203b0 0x56167ab183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5759600640 0 client.4371 ms_handle_reset on v2:172.21.15.156:6836/218190176 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 >> 172.21.15.2:0/2467232280 conn(0x56167a73d3c0 msgr2=0x56167ab3f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.140+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 shutdown_connections 2024-05-14T15:15:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f5782639740 1 -- 172.21.15.2:0/2467232280 wait complete. 2024-05-14T15:15:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f5782639740 20 client.4371 trim_cache size 0 max 16384 2024-05-14T15:15:52.146 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:15:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c9147305-965e-4a8b-a03b-3f802813a40c", 2024-05-14T15:15:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4273, 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 8.7023170289999996, 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 6, 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 26, 2024-05-14T15:15:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 26, 2024-05-14T15:15:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 15.373798416 2024-05-14T15:15:52.148 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:15:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5754076300 msgr2=0x7f5754078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5754076300 0x7f5754078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5768034000 tx=0x7f576802e000 comp rx=0 tx=0).stop 2024-05-14T15:15:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 msgr2=0x7f57740b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 0x7f57740b5090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f576000b3f0 tx=0x7f576000b8b0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 shutdown_connections 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5754076300 0x7f5754078810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5774160720 0x7f57740b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f577415d760 0x7f57740b5090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 --2- 172.21.15.2:0/3976721401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57740cdd80 0x7f57741f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.141+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 >> 172.21.15.2:0/3976721401 conn(0x7f57740739a0 msgr2=0x7f577406f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.142+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 shutdown_connections 2024-05-14T15:15:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.142+0000 7f577a000640 1 -- 172.21.15.2:0/3976721401 wait complete. 2024-05-14T15:15:52.168 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:15:52.168 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:52.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T15:15:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.455+0000 7f6abc600640 1 Processor -- start 2024-05-14T15:15:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.455+0000 7f6abc600640 1 -- start start 2024-05-14T15:15:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6abc600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 0x7f6ab40af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6abc600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab40d1460 con 0x7f6ab415bb90 2024-05-14T15:15:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6abc600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab415ed90 con 0x7f6ab406d700 2024-05-14T15:15:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6abc600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab415eb50 con 0x7f6ab4071530 2024-05-14T15:15:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6ab9c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6ab415bb90 0x7f6ab415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43616/0 (socket says 172.21.15.2:43616) 2024-05-14T15:15:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6ab9c00640 1 -- 172.21.15.2:0/3013294096 learned_addr learned my addr 172.21.15.2:0/3013294096 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6ab9200640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 0x7f6ab40af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.458+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148246547 0 0) 0x7f6ab40d1460 con 0x7f6ab415bb90 2024-05-14T15:15:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a9c003520 con 0x7f6ab415bb90 2024-05-14T15:15:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3314107999 0 0) 0x7f6a9c003520 con 0x7f6ab415bb90 2024-05-14T15:15:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 msgr2=0x7f6ab40af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 0x7f6ab40af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 >> v1:172.21.15.156:6789/0 conn(0x7f6ab406d700 legacy=0x7f6ab406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab415f070 con 0x7f6ab415bb90 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f6aa8001a70 con 0x7f6ab415bb90 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 >> v1:172.21.15.2:6789/0 conn(0x7f6ab415bb90 legacy=0x7f6ab415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9c003a30 0x7f6a9c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c004800 0x7f6a9c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 0x7f6a9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab415eb50 con 0x7f6a9c003a30 2024-05-14T15:15:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c005590 con 0x7f6a9c004800 2024-05-14T15:15:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c00bf00 con 0x7f6ab4071530 2024-05-14T15:15:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.459+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9c003a30 0x7f6a9c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9200640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c004800 0x7f6a9c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6aba600640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 0x7f6a9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9c00640 1 -- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 msgr2=0x7f6a9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4071530 0x7f6a9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9c00640 1 -- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c004800 msgr2=0x7f6a9c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c004800 0x7f6a9c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9c00640 1 -- 172.21.15.2:0/3013294096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c003520 con 0x7f6a9c003a30 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.460+0000 7f6ab9200640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c004800 0x7f6a9c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.461+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9c003a30 0x7f6a9c003ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80013d0 tx=0x7f6a9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7670a241dfd19e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.461+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800a480 con 0x7f6a9c003a30 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.461+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa802f070 con 0x7f6a9c003a30 2024-05-14T15:15:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.461+0000 7f6ab3e00640 1 -- 172.21.15.2:0/3013294096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa802bbc0 con 0x7f6a9c003a30 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6abc600640 1 -- 172.21.15.2:0/3013294096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9c003a30 msgr2=0x7f6a9c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6abc600640 1 --2- 172.21.15.2:0/3013294096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9c003a30 0x7f6a9c003ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80013d0 tx=0x7f6a9c005830 comp rx=0 tx=0).stop 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6aba600640 1 -- 172.21.15.2:0/3013294096 reap_dead start 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6abc600640 1 -- 172.21.15.2:0/3013294096 shutdown_connections 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6abc600640 1 -- 172.21.15.2:0/3013294096 >> 172.21.15.2:0/3013294096 conn(0x7f6ab40d1d10 msgr2=0x7f6ab40734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6abc600640 1 -- 172.21.15.2:0/3013294096 shutdown_connections 2024-05-14T15:15:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.462+0000 7f6abc600640 1 -- 172.21.15.2:0/3013294096 wait complete. 2024-05-14T15:15:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.465+0000 7f6abc600640 1 Processor -- start 2024-05-14T15:15:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.465+0000 7f6abc600640 1 -- start start 2024-05-14T15:15:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.466+0000 7f6abc600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c003a30 0x7f6ab41442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6abc600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4157be0 0x7f6ab4146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6abc600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 0x7f6ab41f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6abc600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab40aeb60 con 0x7f6ab4147140 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6abc600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab415f350 con 0x7f6a9c003a30 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6abc600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab40af080 con 0x7f6ab4157be0 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 0x7f6ab41f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 0x7f6ab41f9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44426/0 (socket says 172.21.15.2:44426) 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 -- 172.21.15.2:0/4205598917 learned_addr learned my addr 172.21.15.2:0/4205598917 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c003a30 0x7f6ab41442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6ab9200640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4157be0 0x7f6ab4146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 -- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4157be0 msgr2=0x7f6ab4146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4157be0 0x7f6ab4146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 -- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c003a30 msgr2=0x7f6ab41442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c003a30 0x7f6ab41442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6aba600640 1 -- 172.21.15.2:0/4205598917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab4147550 con 0x7f6ab4147140 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c003a30 0x7f6ab41442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.467+0000 7f6ab9200640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4157be0 0x7f6ab4146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.468+0000 7f6aba600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 0x7f6ab41f9a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40b6b00 tx=0x7f6aac00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.468+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac019070 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.468+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac0052e0 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.468+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac003830 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.468+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab4148060 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.468+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab4144f80 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.469+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab4148230 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.471+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6aac01c070 con 0x7f6ab4147140 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.472+0000 7f6ab1600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a940762d0 0x7f6a940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.472+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6aac096d00 con 0x7f6ab4147140 2024-05-14T15:15:52.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.473+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a940762d0 0x7f6a940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:52.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.474+0000 7f6ab9c00640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a940762d0 0x7f6a940787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8033000 tx=0x7f6aa8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:52.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.477+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ab4147550 con 0x7f6ab4147140 2024-05-14T15:15:52.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.732+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ab4050870 con 0x7f6ab4147140 2024-05-14T15:15:52.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.734+0000 7f6ab1600640 1 -- 172.21.15.2:0/4205598917 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f6aac060310 con 0x7f6ab4147140 2024-05-14T15:15:52.732 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:15:52.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a940762d0 msgr2=0x7f6a940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a940762d0 0x7f6a940787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8033000 tx=0x7f6aa8007000 comp rx=0 tx=0).stop 2024-05-14T15:15:52.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 msgr2=0x7f6ab41f9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 0x7f6ab41f9a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40b6b00 tx=0x7f6aac00e8a0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 shutdown_connections 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6a940762d0 0x7f6a940787e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4147140 0x7f6ab41f9a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ab4157be0 0x7f6ab4146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 --2- 172.21.15.2:0/4205598917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a9c003a30 0x7f6ab41442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.736+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 >> 172.21.15.2:0/4205598917 conn(0x7f6ab40d1d10 msgr2=0x7f6ab406fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.737+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 shutdown_connections 2024-05-14T15:15:52.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52.737+0000 7f6abc600640 1 -- 172.21.15.2:0/4205598917 wait complete. 2024-05-14T15:15:52.761 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-14T15:15:52.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:15:52.762 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T15:15:52.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:52.762 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-05-14T15:15:52.817 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:15:52.818 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:15:52.819 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-05-14T15:15:52.819 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:15:52.819 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:15:52.819 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-05-14T15:15:52.819 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:15:52.819 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:15:52.820 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-05-14T15:15:52.820 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-14T15:15:52.820 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42611sec preferred_lft 42611sec 2024-05-14T15:15:52.820 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-05-14T15:15:52.820 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:15:52.820 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:15:52.821 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:15:52.821 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-05-14T15:15:52.823 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T15:15:52.823 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:15:52.823 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:15:52.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-05-14T15:15:52.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-05-14T15:15:52.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-05-14T15:15:52.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T15:15:52.824 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:15:52.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:15:53.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:53.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:53.332 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:15:53.411 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-05-14T15:15:53.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:53.415 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-05-14T15:15:53.486 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-05-14T15:15:53.486 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:15:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T15:15:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T15:15:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:15:53.487 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:15:53.487 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:15:53.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T15:15:53.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T15:15:53.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T15:15:53.488 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:15:53.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:15:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:54.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:54.250 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-05-14T15:15:54.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:54.298 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-05-14T15:15:54.394 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:15:54.394 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:15:54.394 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:54.394 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-14T15:15:54.395 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:15:54.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:54.577 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-14T15:15:54.578 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:15:54.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:15:54.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:54.853 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:15:54.853 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:15:54.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-05-14T15:15:54.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T15:15:54.853 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:15:54.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:15:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:55.045 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-14T15:15:55.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:15:55.045 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:55.092 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T15:15:55.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:15:55.092 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:55.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:15:55.282 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:15:55.331 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:15:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:15:55.334 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:15:55.334 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:15:55.334 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:55.334 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:55.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:55.335 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:15:55.378 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T15:15:55.379 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-14T15:15:55.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:15:55.497 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:15:55.536 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:15:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:55.538 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:55.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:55.539 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:15:55.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:2024-05-14T15:15:55.752+0000 7fad6531d480 -1 init, newargv = 0x55d2bd9dc840 newargc=15 2024-05-14T15:15:55.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[41596]: starting ceph client 2024-05-14T15:15:55.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[41596]: starting fuse 2024-05-14T15:15:56.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:15:56.823 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:15:56.880 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:15:56.881 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:15:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:15:56.883 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:15:56.883 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:56.883 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:15:56.883 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:56.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:56.884 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:15:56.938 INFO:teuthology.orchestra.run.smithi002.stdout:40 2024-05-14T15:15:56.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-14T15:15:56.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:15:56.939 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-05-14T15:15:56.939 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-05-14T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-05-14T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-05-14T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-05-14T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-14T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-05-14T15:15:56.941 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-14T15:15:56.941 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:15:56.941 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-05-14T15:15:56.941 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-05-14T15:15:56.941 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-05-14T15:15:56.941 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-05-14T15:15:56.942 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-05-14T15:15:56.943 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-05-14T15:15:56.943 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:15:56.943 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:15:56.943 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.admin")) 2024-05-14T15:15:56.943 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-05-14T15:15:57.125 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.admin.41596.asok 2024-05-14T15:15:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:57.142 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41596.asok 2024-05-14T15:15:57.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:57.143 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41596.asok status 2024-05-14T15:15:57.450 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:15:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-05-14T15:15:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:15:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "admin", 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "41596", 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4386, 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-05-14T15:15:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4386 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3278603524 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3278603524 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:15:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4386 192.168.0.1:0/3278603524", 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/3278603524", 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 6, 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 26, 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-05-14T15:15:57.453 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:15:57.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:57.471 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-05-14T15:15:57.471 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:57.526 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-05-14T15:15:57.526 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:57.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:57.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:57.615 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-14T15:15:57.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T15:15:57.779 INFO:teuthology.orchestra.run.smithi002.stdout:# file: . 2024-05-14T15:15:57.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-14T15:15:57.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:15:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:15:57.791 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:57.791 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:15:57.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:15:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.123+0000 7f9317400640 1 Processor -- start 2024-05-14T15:15:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.123+0000 7f9317400640 1 -- start start 2024-05-14T15:15:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9317400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9310161420 0x7f931015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9317400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93100cd9d0 0x7f931015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9317400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f931015e190 0x7f9310070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9317400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9310161950 con 0x7f9310161420 2024-05-14T15:15:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9317400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f931015d7c0 con 0x7f931015e190 2024-05-14T15:15:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9317400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f931006c820 con 0x7f93100cd9d0 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9314a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9310161420 0x7f931015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9314a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9310161420 0x7f931015d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44434/0 (socket says 172.21.15.2:44434) 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f9314a00640 1 -- 172.21.15.2:0/7905414 learned_addr learned my addr 172.21.15.2:0/7905414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.126+0000 7f930fe00640 1 --2- 172.21.15.2:0/7905414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93100cd9d0 0x7f931015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.127+0000 7f9315400640 1 --2- 172.21.15.2:0/7905414 >> v2:172.21.15.156:3300/0 conn(0x7f931015e190 0x7f9310070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.127+0000 7f9314a00640 1 -- 172.21.15.2:0/7905414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93100cd9d0 msgr2=0x7f931015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.127+0000 7f9314a00640 1 --2- 172.21.15.2:0/7905414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93100cd9d0 0x7f931015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.127+0000 7f9314a00640 1 -- 172.21.15.2:0/7905414 >> v2:172.21.15.156:3300/0 conn(0x7f931015e190 msgr2=0x7f9310070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.127+0000 7f9314a00640 1 --2- 172.21.15.2:0/7905414 >> v2:172.21.15.156:3300/0 conn(0x7f931015e190 0x7f9310070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.127+0000 7f9314a00640 1 -- 172.21.15.2:0/7905414 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931006cb00 con 0x7f9310161420 2024-05-14T15:15:58.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.128+0000 7f9314a00640 1 --2- 172.21.15.2:0/7905414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015d120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f931006edc0 tx=0x7f930402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5ab6cf53c77161 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.128+0000 7f930f400640 1 -- 172.21.15.2:0/7905414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304037070 con 0x7f9310161420 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.128+0000 7f930f400640 1 -- 172.21.15.2:0/7905414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9304032440 con 0x7f9310161420 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.128+0000 7f930f400640 1 -- 172.21.15.2:0/7905414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304032810 con 0x7f9310161420 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 -- 172.21.15.2:0/7905414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 msgr2=0x7f931015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 --2- 172.21.15.2:0/7905414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015d120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f931006edc0 tx=0x7f930402a140 comp rx=0 tx=0).stop 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 -- 172.21.15.2:0/7905414 shutdown_connections 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 --2- 172.21.15.2:0/7905414 >> v2:172.21.15.156:3300/0 conn(0x7f931015e190 0x7f9310070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 --2- 172.21.15.2:0/7905414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93100cd9d0 0x7f931015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 --2- 172.21.15.2:0/7905414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015d120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 -- 172.21.15.2:0/7905414 >> 172.21.15.2:0/7905414 conn(0x7f93100ce230 msgr2=0x7f93100ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 -- 172.21.15.2:0/7905414 shutdown_connections 2024-05-14T15:15:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.129+0000 7f9317400640 1 -- 172.21.15.2:0/7905414 wait complete. 2024-05-14T15:15:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.132+0000 7f9317400640 1 Processor -- start 2024-05-14T15:15:58.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.132+0000 7f9317400640 1 -- start start 2024-05-14T15:15:58.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.133+0000 7f9317400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93100cd9d0 0x7f931009e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.133+0000 7f9317400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f931015e190 0x7f931014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.133+0000 7f9317400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.133+0000 7f9317400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93100709c0 con 0x7f9310161420 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.133+0000 7f9317400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f93100cf390 con 0x7f93100cd9d0 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.133+0000 7f9317400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f9310070b40 con 0x7f931015e190 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44446/0 (socket says 172.21.15.2:44446) 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 -- 172.21.15.2:0/149649418 learned_addr learned my addr 172.21.15.2:0/149649418 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9314a00640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93100cd9d0 0x7f931009e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f930fe00640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f931015e190 0x7f931014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 -- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f931015e190 msgr2=0x7f931014a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f931015e190 0x7f931014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 -- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93100cd9d0 msgr2=0x7f931009e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93100cd9d0 0x7f931009e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.134+0000 7f9315400640 1 -- 172.21.15.2:0/149649418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931009eb10 con 0x7f9310161420 2024-05-14T15:15:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.135+0000 7f9315400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015a460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9308007d80 tx=0x7f930800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.135+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308014420 con 0x7f9310161420 2024-05-14T15:15:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.135+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9308019070 con 0x7f9310161420 2024-05-14T15:15:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.135+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308014800 con 0x7f9310161420 2024-05-14T15:15:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.135+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931009edf0 con 0x7f9310161420 2024-05-14T15:15:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.135+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931009f3b0 con 0x7f9310161420 2024-05-14T15:15:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.136+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9310050870 con 0x7f9310161420 2024-05-14T15:15:58.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.138+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93080149a0 con 0x7f9310161420 2024-05-14T15:15:58.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.139+0000 7f930cc00640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f92f00762d0 0x7f92f00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.139+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93080982e0 con 0x7f9310161420 2024-05-14T15:15:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.140+0000 7f9314a00640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f92f00762d0 0x7f92f00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.141+0000 7f9314a00640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f92f00762d0 0x7f92f00787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9304034000 tx=0x7f930402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.145+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93080617d0 con 0x7f9310161420 2024-05-14T15:15:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.369+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f931009e8a0 con 0x7f9310161420 2024-05-14T15:15:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.370+0000 7f930cc00640 1 -- 172.21.15.2:0/149649418 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f93080610d0 con 0x7f9310161420 2024-05-14T15:15:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:15:58.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f92f00762d0 msgr2=0x7f92f00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f92f00762d0 0x7f92f00787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9304034000 tx=0x7f930402e000 comp rx=0 tx=0).stop 2024-05-14T15:15:58.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 msgr2=0x7f931015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015a460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9308007d80 tx=0x7f930800e4b0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 shutdown_connections 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f92f00762d0 0x7f92f00787e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9310161420 0x7f931015a460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f931015e190 0x7f931014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 --2- 172.21.15.2:0/149649418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93100cd9d0 0x7f931009e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 >> 172.21.15.2:0/149649418 conn(0x7f93100ce230 msgr2=0x7f9310160880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 shutdown_connections 2024-05-14T15:15:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.373+0000 7f9317400640 1 -- 172.21.15.2:0/149649418 wait complete. 2024-05-14T15:15:58.396 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:15:58.396 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:15:58.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:15:58.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.731+0000 7f7894e00640 1 Processor -- start 2024-05-14T15:15:58.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.731+0000 7f7894e00640 1 -- start start 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.733+0000 7f7894e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f789006ce00 0x7f78900b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.733+0000 7f7894e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f78900af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.733+0000 7f7894e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7890160650 con 0x7f78900b1150 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.733+0000 7f7894e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f78900b1560 con 0x7f789006ce00 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.733+0000 7f7894e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f78900b0f40 con 0x7f78900af390 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f78900b1150 0x7f789006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43622/0 (socket says 172.21.15.2:43622) 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788f400640 1 -- 172.21.15.2:0/3044739243 learned_addr learned my addr 172.21.15.2:0/3044739243 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:15:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788ea00640 1 --2- 172.21.15.2:0/3044739243 >> v2:172.21.15.2:3300/0 conn(0x7f789006ce00 0x7f78900b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788fe00640 1 --2- 172.21.15.2:0/3044739243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f78900af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788e000640 1 -- 172.21.15.2:0/3044739243 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819503558 0 0) 0x7f7890160650 con 0x7f78900b1150 2024-05-14T15:15:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788e000640 1 -- 172.21.15.2:0/3044739243 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7874003520 con 0x7f78900b1150 2024-05-14T15:15:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788ea00640 1 -- 172.21.15.2:0/3044739243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 msgr2=0x7f78900af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:15:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788ea00640 1 --2- 172.21.15.2:0/3044739243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f78900af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788ea00640 1 -- 172.21.15.2:0/3044739243 >> v1:172.21.15.2:6789/0 conn(0x7f78900b1150 legacy=0x7f789006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.734+0000 7f788ea00640 1 -- 172.21.15.2:0/3044739243 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7890160930 con 0x7f789006ce00 2024-05-14T15:15:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.736+0000 7f788ea00640 1 --2- 172.21.15.2:0/3044739243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789006ce00 0x7f78900b0a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f787c0097a0 tx=0x7f787c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc0565951cb1d44 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.736+0000 7f788e000640 1 -- 172.21.15.2:0/3044739243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c037070 con 0x7f789006ce00 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.736+0000 7f788e000640 1 -- 172.21.15.2:0/3044739243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c032440 con 0x7f789006ce00 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.736+0000 7f788e000640 1 -- 172.21.15.2:0/3044739243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c032810 con 0x7f789006ce00 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 -- 172.21.15.2:0/3044739243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789006ce00 msgr2=0x7f78900b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 --2- 172.21.15.2:0/3044739243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789006ce00 0x7f78900b0a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f787c0097a0 tx=0x7f787c02a180 comp rx=0 tx=0).stop 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 -- 172.21.15.2:0/3044739243 shutdown_connections 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 --2- 172.21.15.2:0/3044739243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f78900af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 --2- 172.21.15.2:0/3044739243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789006ce00 0x7f78900b0a00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 -- 172.21.15.2:0/3044739243 >> 172.21.15.2:0/3044739243 conn(0x7f78900d19d0 msgr2=0x7f78900d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 -- 172.21.15.2:0/3044739243 shutdown_connections 2024-05-14T15:15:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.737+0000 7f7894e00640 1 -- 172.21.15.2:0/3044739243 wait complete. 2024-05-14T15:15:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.739+0000 7f7894e00640 1 Processor -- start 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.740+0000 7f7894e00640 1 -- start start 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f7894e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f7890158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f7894e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78900b1150 0x7f789014c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f7894e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 0x7f78900ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f7894e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78901611d0 con 0x7f78900ce8f0 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f7894e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7890160ef0 con 0x7f78900b1150 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f7894e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f789015dd70 con 0x7f78900af390 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.741+0000 7f788fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 0x7f78900ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 0x7f78900ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44472/0 (socket says 172.21.15.2:44472) 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 -- 172.21.15.2:0/945022956 learned_addr learned my addr 172.21.15.2:0/945022956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788ea00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78900b1150 0x7f789014c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788f400640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f7890158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 -- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 msgr2=0x7f7890158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f7890158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 -- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78900b1150 msgr2=0x7f789014c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78900b1150 0x7f789014c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 -- 172.21.15.2:0/945022956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7890158bb0 con 0x7f78900ce8f0 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.742+0000 7f788fe00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 0x7f78900ced00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f788800d5a0 tx=0x7f788800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.743+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78880125f0 con 0x7f78900ce8f0 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.743+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7888019070 con 0x7f78900ce8f0 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.743+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78880129f0 con 0x7f78900ce8f0 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.743+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7890158e90 con 0x7f78900ce8f0 2024-05-14T15:15:58.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.743+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7890159450 con 0x7f78900ce8f0 2024-05-14T15:15:58.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.744+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7890158900 con 0x7f78900ce8f0 2024-05-14T15:15:58.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.746+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7888012b90 con 0x7f78900ce8f0 2024-05-14T15:15:58.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.747+0000 7f7887400640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78700762d0 0x7f78700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.747+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7888097e60 con 0x7f78900ce8f0 2024-05-14T15:15:58.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.747+0000 7f788f400640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78700762d0 0x7f78700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.748+0000 7f788f400640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78700762d0 0x7f78700787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7880001760 tx=0x7f7880009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.752+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7888061360 con 0x7f78900ce8f0 2024-05-14T15:15:58.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.978+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f789006dc50 con 0x7f78900ce8f0 2024-05-14T15:15:58.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.979+0000 7f7887400640 1 -- 172.21.15.2:0/945022956 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f7888060c60 con 0x7f78900ce8f0 2024-05-14T15:15:58.977 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78700762d0 msgr2=0x7f78700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78700762d0 0x7f78700787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7880001760 tx=0x7f7880009040 comp rx=0 tx=0).stop 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 msgr2=0x7f78900ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 0x7f78900ced00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f788800d5a0 tx=0x7f788800da60 comp rx=0 tx=0).stop 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 shutdown_connections 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78700762d0 0x7f78700787e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78900b1150 0x7f789014c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78900ce8f0 0x7f78900ced00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 --2- 172.21.15.2:0/945022956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78900af390 0x7f7890158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 >> 172.21.15.2:0/945022956 conn(0x7f78900d19d0 msgr2=0x7f789015ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 shutdown_connections 2024-05-14T15:15:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:15:58.982+0000 7f7894e00640 1 -- 172.21.15.2:0/945022956 wait complete. 2024-05-14T15:15:59.008 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-05-14T15:15:59.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:15:59.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:15:59.081 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[41596]: fuse finished with error 0 and tester_r 0 2024-05-14T15:15:59.085 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:05.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:16:05.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:05.187 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-14T15:16:05.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:05.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.534+0000 7f459ce00640 1 Processor -- start 2024-05-14T15:16:05.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.534+0000 7f459ce00640 1 -- start start 2024-05-14T15:16:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f459ce00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45980af760 0x7f4598168c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f459ce00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45981618d0 con 0x7f459806d700 2024-05-14T15:16:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f459ce00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4598161bb0 con 0x7f45980d1050 2024-05-14T15:16:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f459ce00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f45981624e0 con 0x7f45980af760 2024-05-14T15:16:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f458fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f459806d700 0x7f459806db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43344/0 (socket says 172.21.15.2:43344) 2024-05-14T15:16:05.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f458fe00640 1 -- 172.21.15.2:0/841909611 learned_addr learned my addr 172.21.15.2:0/841909611 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:05.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728923382 0 0) 0x7f45981618d0 con 0x7f459806d700 2024-05-14T15:16:05.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.537+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f457c003520 con 0x7f459806d700 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4597e00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45980af760 0x7f4598168c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1840488693 0 0) 0x7f457c003520 con 0x7f459806d700 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45980af760 msgr2=0x7f4598168c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45980af760 0x7f4598168c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 >> v1:172.21.15.156:6789/0 conn(0x7f45980d1050 legacy=0x7f4598070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4598161e90 con 0x7f459806d700 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f45800016f0 con 0x7f459806d700 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 >> v1:172.21.15.2:6789/0 conn(0x7f459806d700 legacy=0x7f459806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f457c003a30 0x7f457c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f457c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f457c005270 0x7f457c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45981624e0 con 0x7f457c004800 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f457c00bfb0 con 0x7f457c003a30 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.538+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f457c00c1b0 con 0x7f457c005270 2024-05-14T15:16:05.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f458fe00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f457c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f4597400640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f457c003a30 0x7f457c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f458fe00640 1 -- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f457c005270 msgr2=0x7f457c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f458fe00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f457c005270 0x7f457c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f458fe00640 1 -- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f457c003a30 msgr2=0x7f457c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f458fe00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f457c003a30 0x7f457c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f458fe00640 1 -- 172.21.15.2:0/841909611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c003520 con 0x7f457c004800 2024-05-14T15:16:05.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.539+0000 7f4597400640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f457c003a30 0x7f457c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.540+0000 7f458fe00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f457c004c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f458000c240 tx=0x7f457c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341d49ee0d4ce18d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.540+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580007d70 con 0x7f457c004800 2024-05-14T15:16:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.540+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4580005af0 con 0x7f457c004800 2024-05-14T15:16:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.540+0000 7f4596a00640 1 -- 172.21.15.2:0/841909611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580007070 con 0x7f457c004800 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f459ce00640 1 -- 172.21.15.2:0/841909611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 msgr2=0x7f457c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f459ce00640 1 --2- 172.21.15.2:0/841909611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f457c004c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f458000c240 tx=0x7f457c005830 comp rx=0 tx=0).stop 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f4597e00640 1 -- 172.21.15.2:0/841909611 reap_dead start 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f459ce00640 1 -- 172.21.15.2:0/841909611 shutdown_connections 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f459ce00640 1 -- 172.21.15.2:0/841909611 >> 172.21.15.2:0/841909611 conn(0x7f45980732e0 msgr2=0x7f45980736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f459ce00640 1 -- 172.21.15.2:0/841909611 shutdown_connections 2024-05-14T15:16:05.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.541+0000 7f459ce00640 1 -- 172.21.15.2:0/841909611 wait complete. 2024-05-14T15:16:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.544+0000 7f459ce00640 1 Processor -- start 2024-05-14T15:16:05.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.544+0000 7f459ce00640 1 -- start start 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.545+0000 7f459ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f45980cff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.545+0000 7f459ce00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f459815e3a0 0x7f459815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.545+0000 7f459ce00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f459809c020 0x7f459809c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f459ce00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f459815f110 con 0x7f457c004800 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f459ce00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4598071050 con 0x7f459815e3a0 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f459ce00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f459815f290 con 0x7f459809c020 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f45980cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f45980cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56874/0 (socket says 172.21.15.2:56874) 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 -- 172.21.15.2:0/216302039 learned_addr learned my addr 172.21.15.2:0/216302039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 -- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f459809c020 msgr2=0x7f459809c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f459809c020 0x7f459809c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 -- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f459815e3a0 msgr2=0x7f459815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f459815e3a0 0x7f459815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 -- 172.21.15.2:0/216302039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459815ecf0 con 0x7f457c004800 2024-05-14T15:16:05.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.546+0000 7f4597400640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f45980cff90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f458800d560 tx=0x7f458800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:05.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.547+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588005480 con 0x7f457c004800 2024-05-14T15:16:05.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.547+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4588017070 con 0x7f457c004800 2024-05-14T15:16:05.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.547+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45980d08e0 con 0x7f457c004800 2024-05-14T15:16:05.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.547+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588003870 con 0x7f457c004800 2024-05-14T15:16:05.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.547+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459809b820 con 0x7f457c004800 2024-05-14T15:16:05.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.548+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4598050870 con 0x7f457c004800 2024-05-14T15:16:05.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.549+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4588003a10 con 0x7f457c004800 2024-05-14T15:16:05.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.551+0000 7f458f400640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f45740762d0 0x7f45740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:05.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.551+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f45880976c0 con 0x7f457c004800 2024-05-14T15:16:05.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.552+0000 7f458fe00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f45740762d0 0x7f45740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:05.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.553+0000 7f458fe00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f45740762d0 0x7f45740787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4580032000 tx=0x7f4580007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:05.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.557+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f459815ecf0 con 0x7f457c004800 2024-05-14T15:16:05.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.772+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4598074450 con 0x7f457c004800 2024-05-14T15:16:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.774+0000 7f458f400640 1 -- 172.21.15.2:0/216302039 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7f4588060ce0 con 0x7f457c004800 2024-05-14T15:16:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:05.774 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f45740762d0 msgr2=0x7f45740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f45740762d0 0x7f45740787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4580032000 tx=0x7f4580007000 comp rx=0 tx=0).stop 2024-05-14T15:16:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 msgr2=0x7f45980cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:05.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f45980cff90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f458800d560 tx=0x7f458800da20 comp rx=0 tx=0).stop 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 shutdown_connections 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f45740762d0 0x7f45740787e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f459815e3a0 0x7f459815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f459809c020 0x7f459809c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 --2- 172.21.15.2:0/216302039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f457c004800 0x7f45980cff90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 >> 172.21.15.2:0/216302039 conn(0x7f45980732e0 msgr2=0x7f459806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 shutdown_connections 2024-05-14T15:16:05.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:05.777+0000 7f459ce00640 1 -- 172.21.15.2:0/216302039 wait complete. 2024-05-14T15:16:05.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:06.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.087+0000 7f7314200640 1 Processor -- start 2024-05-14T15:16:06.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.088+0000 7f7314200640 1 -- start start 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.090+0000 7f7314200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f730c164540 0x7f730c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.090+0000 7f7314200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.090+0000 7f7314200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f730c06dc40 0x7f730c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.090+0000 7f7314200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f730c164950 con 0x7f730c06dc40 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.090+0000 7f7314200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f730c168fd0 con 0x7f730c164540 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.090+0000 7f7314200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f730c06e050 con 0x7f730c0af2d0 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f730c06dc40 0x7f730c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f730c06dc40 0x7f730c0b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56880/0 (socket says 172.21.15.2:56880) 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 -- 172.21.15.2:0/2643383413 learned_addr learned my addr 172.21.15.2:0/2643383413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:06.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7311800640 1 --2- 172.21.15.2:0/2643383413 >> v2:172.21.15.156:3300/0 conn(0x7f730c164540 0x7f730c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7310e00640 1 --2- 172.21.15.2:0/2643383413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 -- 172.21.15.2:0/2643383413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 msgr2=0x7f730c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:06.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 --2- 172.21.15.2:0/2643383413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 -- 172.21.15.2:0/2643383413 >> v2:172.21.15.156:3300/0 conn(0x7f730c164540 msgr2=0x7f730c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 --2- 172.21.15.2:0/2643383413 >> v2:172.21.15.156:3300/0 conn(0x7f730c164540 0x7f730c070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7312200640 1 -- 172.21.15.2:0/2643383413 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c168450 con 0x7f730c06dc40 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.091+0000 7f7311800640 1 --2- 172.21.15.2:0/2643383413 >> v2:172.21.15.156:3300/0 conn(0x7f730c164540 0x7f730c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.092+0000 7f7312200640 1 --2- 172.21.15.2:0/2643383413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c06dc40 0x7f730c0b49e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f730c09fa30 tx=0x7f730402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64653654d010a126 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.093+0000 7f730be00640 1 -- 172.21.15.2:0/2643383413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304036070 con 0x7f730c06dc40 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.093+0000 7f730be00640 1 -- 172.21.15.2:0/2643383413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304031600 con 0x7f730c06dc40 2024-05-14T15:16:06.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.093+0000 7f730be00640 1 -- 172.21.15.2:0/2643383413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040319d0 con 0x7f730c06dc40 2024-05-14T15:16:06.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.093+0000 7f7314200640 1 -- 172.21.15.2:0/2643383413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c06dc40 msgr2=0x7f730c0b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.093+0000 7f7314200640 1 --2- 172.21.15.2:0/2643383413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c06dc40 0x7f730c0b49e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f730c09fa30 tx=0x7f730402a610 comp rx=0 tx=0).stop 2024-05-14T15:16:06.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 -- 172.21.15.2:0/2643383413 shutdown_connections 2024-05-14T15:16:06.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 --2- 172.21.15.2:0/2643383413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c06dc40 0x7f730c0b49e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 --2- 172.21.15.2:0/2643383413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 --2- 172.21.15.2:0/2643383413 >> v2:172.21.15.156:3300/0 conn(0x7f730c164540 0x7f730c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 -- 172.21.15.2:0/2643383413 >> 172.21.15.2:0/2643383413 conn(0x7f730c0d1d10 msgr2=0x7f730c0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:06.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 -- 172.21.15.2:0/2643383413 shutdown_connections 2024-05-14T15:16:06.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.094+0000 7f7314200640 1 -- 172.21.15.2:0/2643383413 wait complete. 2024-05-14T15:16:06.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.096+0000 7f7314200640 1 Processor -- start 2024-05-14T15:16:06.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.097+0000 7f7314200640 1 -- start start 2024-05-14T15:16:06.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.098+0000 7f7314200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c06dc40 0x7f730c1fe090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.098+0000 7f7314200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c1fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.098+0000 7f7314200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 0x7f730c1f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.098+0000 7f7314200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f730c168cf0 con 0x7f730c164540 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.098+0000 7f7314200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f730c168a10 con 0x7f730c06dc40 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.098+0000 7f7314200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f730c0af6e0 con 0x7f730c0af2d0 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 0x7f730c1f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 0x7f730c1f9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56892/0 (socket says 172.21.15.2:56892) 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 -- 172.21.15.2:0/1365349708 learned_addr learned my addr 172.21.15.2:0/1365349708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7310e00640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c1fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7311800640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c06dc40 0x7f730c1fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 -- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 msgr2=0x7f730c1fe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c1fe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 -- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c06dc40 msgr2=0x7f730c1fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c06dc40 0x7f730c1fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.099+0000 7f7312200640 1 -- 172.21.15.2:0/1365349708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c15a170 con 0x7f730c164540 2024-05-14T15:16:06.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.100+0000 7f7312200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 0x7f730c1f9f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7304009f40 tx=0x7f7304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.100+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304036050 con 0x7f730c164540 2024-05-14T15:16:06.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.100+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304042070 con 0x7f730c164540 2024-05-14T15:16:06.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.100+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304009510 con 0x7f730c164540 2024-05-14T15:16:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.100+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c15a450 con 0x7f730c164540 2024-05-14T15:16:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.100+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c15aa10 con 0x7f730c164540 2024-05-14T15:16:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.101+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c050870 con 0x7f730c164540 2024-05-14T15:16:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.102+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7304007bd0 con 0x7f730c164540 2024-05-14T15:16:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.104+0000 7f7309600640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72ec0762d0 0x7f72ec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.104+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f73040b8940 con 0x7f730c164540 2024-05-14T15:16:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.104+0000 7f7311800640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72ec0762d0 0x7f72ec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.106+0000 7f7311800640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72ec0762d0 0x7f72ec0787e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7300006fd0 tx=0x7f7300008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.109+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7304081e30 con 0x7f730c164540 2024-05-14T15:16:06.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.320+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f730c153100 con 0x7f730c164540 2024-05-14T15:16:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.323+0000 7f7309600640 1 -- 172.21.15.2:0/1365349708 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7f7304081730 con 0x7f730c164540 2024-05-14T15:16:06.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:06.323 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72ec0762d0 msgr2=0x7f72ec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72ec0762d0 0x7f72ec0787e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7300006fd0 tx=0x7f7300008040 comp rx=0 tx=0).stop 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 msgr2=0x7f730c1f9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 0x7f730c1f9f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7304009f40 tx=0x7f7304004a40 comp rx=0 tx=0).stop 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 shutdown_connections 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f72ec0762d0 0x7f72ec0787e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f730c164540 0x7f730c1f9f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0af2d0 0x7f730c1fe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 --2- 172.21.15.2:0/1365349708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c06dc40 0x7f730c1fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 >> 172.21.15.2:0/1365349708 conn(0x7f730c0d1d10 msgr2=0x7f730c0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.326+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 shutdown_connections 2024-05-14T15:16:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.327+0000 7f7314200640 1 -- 172.21.15.2:0/1365349708 wait complete. 2024-05-14T15:16:06.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T15:16:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.650+0000 7fcdddc00640 1 Processor -- start 2024-05-14T15:16:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.650+0000 7fcdddc00640 1 -- start start 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.652+0000 7fcdddc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdd815dd00 0x7fcdd80d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.652+0000 7fcdddc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcdd806d590 0x7fcdd806d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.652+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806c6f0 0x7fcdd806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.652+0000 7fcdddc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd8160a10 con 0x7fcdd815dd00 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.652+0000 7fcdddc00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd80d4c40 con 0x7fcdd806d590 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.652+0000 7fcdddc00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd815e110 con 0x7fcdd806c6f0 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdd815dd00 0x7fcdd80d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdd815dd00 0x7fcdd80d50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56898/0 (socket says 172.21.15.2:56898) 2024-05-14T15:16:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1588273350 learned_addr learned my addr 172.21.15.2:0/1588273350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd7400640 1 --2- 172.21.15.2:0/1588273350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806c6f0 0x7fcdd806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6000640 1 --2- 172.21.15.2:0/1588273350 >> v2:172.21.15.156:3300/0 conn(0x7fcdd806d590 0x7fcdd806d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1588273350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806c6f0 msgr2=0x7fcdd806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 --2- 172.21.15.2:0/1588273350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806c6f0 0x7fcdd806cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1588273350 >> v2:172.21.15.156:3300/0 conn(0x7fcdd806d590 msgr2=0x7fcdd806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 --2- 172.21.15.2:0/1588273350 >> v2:172.21.15.156:3300/0 conn(0x7fcdd806d590 0x7fcdd806d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.653+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1588273350 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd80d5610 con 0x7fcdd815dd00 2024-05-14T15:16:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.654+0000 7fcdd6a00640 1 --2- 172.21.15.2:0/1588273350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd815dd00 0x7fcdd80d50d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80d4dc0 tx=0x7fcdc802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39119c2681ff9477 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.655+0000 7fcdd5600640 1 -- 172.21.15.2:0/1588273350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8037070 con 0x7fcdd815dd00 2024-05-14T15:16:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.655+0000 7fcdd5600640 1 -- 172.21.15.2:0/1588273350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8032440 con 0x7fcdd815dd00 2024-05-14T15:16:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.655+0000 7fcdd5600640 1 -- 172.21.15.2:0/1588273350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8032810 con 0x7fcdd815dd00 2024-05-14T15:16:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 -- 172.21.15.2:0/1588273350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd815dd00 msgr2=0x7fcdd80d50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1588273350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd815dd00 0x7fcdd80d50d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80d4dc0 tx=0x7fcdc802a1c0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 -- 172.21.15.2:0/1588273350 shutdown_connections 2024-05-14T15:16:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1588273350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806c6f0 0x7fcdd806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1588273350 >> v2:172.21.15.156:3300/0 conn(0x7fcdd806d590 0x7fcdd806d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1588273350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd815dd00 0x7fcdd80d50d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 -- 172.21.15.2:0/1588273350 >> 172.21.15.2:0/1588273350 conn(0x7fcdd80d5aa0 msgr2=0x7fcdd80d5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 -- 172.21.15.2:0/1588273350 shutdown_connections 2024-05-14T15:16:06.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.656+0000 7fcdddc00640 1 -- 172.21.15.2:0/1588273350 wait complete. 2024-05-14T15:16:06.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.658+0000 7fcdddc00640 1 Processor -- start 2024-05-14T15:16:06.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.659+0000 7fcdddc00640 1 -- start start 2024-05-14T15:16:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.660+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 0x7fcdd80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.660+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806d590 0x7fcdd814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.660+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd815dd00 0x7fcdd814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.660+0000 7fcdddc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd80d48d0 con 0x7fcdd806c6f0 2024-05-14T15:16:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.660+0000 7fcdddc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd80d45f0 con 0x7fcdd815dd00 2024-05-14T15:16:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.660+0000 7fcdddc00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd81606c0 con 0x7fcdd806d590 2024-05-14T15:16:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 0x7fcdd80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 0x7fcdd80cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56906/0 (socket says 172.21.15.2:56906) 2024-05-14T15:16:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1585418287 learned_addr learned my addr 172.21.15.2:0/1585418287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6000640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806d590 0x7fcdd814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd7400640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd815dd00 0x7fcdd814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806d590 msgr2=0x7fcdd814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806d590 0x7fcdd814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd815dd00 msgr2=0x7fcdd814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd815dd00 0x7fcdd814e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 -- 172.21.15.2:0/1585418287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd814e710 con 0x7fcdd806c6f0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.661+0000 7fcdd6a00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 0x7fcdd80cea80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8000c00 tx=0x7fcdc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.662+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8037040 con 0x7fcdd806c6f0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.662+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8042070 con 0x7fcdd806c6f0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.662+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd80c9cd0 con 0x7fcdd806c6f0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.662+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8030bb0 con 0x7fcdd806c6f0 2024-05-14T15:16:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.662+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd80ca290 con 0x7fcdd806c6f0 2024-05-14T15:16:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.663+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd8050870 con 0x7fcdd806c6f0 2024-05-14T15:16:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.666+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcdc802ad10 con 0x7fcdd806c6f0 2024-05-14T15:16:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.667+0000 7fcdcea00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcdb40762d0 0x7fcdb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.667+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcdc80b8e50 con 0x7fcdd806c6f0 2024-05-14T15:16:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.668+0000 7fcdd6000640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcdb40762d0 0x7fcdb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.669+0000 7fcdd6000640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcdb40762d0 0x7fcdb40787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0006fd0 tx=0x7fcdc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.670+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcdc80823c0 con 0x7fcdd806c6f0 2024-05-14T15:16:06.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:06.929+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcdd80c9380 con 0x7fcdd806c6f0 2024-05-14T15:16:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.579+0000 7fcdcea00640 1 -- 172.21.15.2:0/1585418287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fcdc8081cc0 con 0x7fcdd806c6f0 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcdb40762d0 msgr2=0x7fcdb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcdb40762d0 0x7fcdb40787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0006fd0 tx=0x7fcdc0008040 comp rx=0 tx=0).stop 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 msgr2=0x7fcdd80cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 0x7fcdd80cea80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8000c00 tx=0x7fcdc80046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 shutdown_connections 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcdb40762d0 0x7fcdb40787e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd815dd00 0x7fcdd814e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdd806d590 0x7fcdd814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 --2- 172.21.15.2:0/1585418287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd806c6f0 0x7fcdd80cea80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 >> 172.21.15.2:0/1585418287 conn(0x7fcdd80d5aa0 msgr2=0x7fcdd80b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:07.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.583+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 shutdown_connections 2024-05-14T15:16:07.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.584+0000 7fcdddc00640 1 -- 172.21.15.2:0/1585418287 wait complete. 2024-05-14T15:16:07.616 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-14T15:16:07.616 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T15:16:07.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.908+0000 7fd0e9000640 1 Processor -- start 2024-05-14T15:16:07.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.908+0000 7fd0e9000640 1 -- start start 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e9000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e415c800 0x7fd0e406cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e9000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0e406d4c0 0x7fd0e4160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e9000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e40ae7c0 con 0x7fd0e40b0eb0 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e9000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e40b4fc0 con 0x7fd0e406d4c0 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e9000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e406fcb0 con 0x7fd0e415c800 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0e406d4c0 0x7fd0e4160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0e406d4c0 0x7fd0e4160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56912/0 (socket says 172.21.15.2:56912) 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.911+0000 7fd0e2800640 1 -- 172.21.15.2:0/3719518625 learned_addr learned my addr 172.21.15.2:0/3719518625 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:07.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.912+0000 7fd0e1e00640 1 --2- 172.21.15.2:0/3719518625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e415c800 0x7fd0e406cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.912+0000 7fd0e2800640 1 -- 172.21.15.2:0/3719518625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e415c800 msgr2=0x7fd0e406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.912+0000 7fd0e2800640 1 --2- 172.21.15.2:0/3719518625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e415c800 0x7fd0e406cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.912+0000 7fd0e2800640 1 -- 172.21.15.2:0/3719518625 >> v1:172.21.15.156:6789/0 conn(0x7fd0e40b0eb0 legacy=0x7fd0e4160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.912+0000 7fd0e2800640 1 -- 172.21.15.2:0/3719518625 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e406d8d0 con 0x7fd0e406d4c0 2024-05-14T15:16:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.913+0000 7fd0e2800640 1 --2- 172.21.15.2:0/3719518625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4160870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0098a0 tx=0x7fd0dc02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ea65ce1bdda7fb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:07.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.913+0000 7fd0e0a00640 1 -- 172.21.15.2:0/3719518625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc037070 con 0x7fd0e406d4c0 2024-05-14T15:16:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.913+0000 7fd0e0a00640 1 -- 172.21.15.2:0/3719518625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc032440 con 0x7fd0e406d4c0 2024-05-14T15:16:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.913+0000 7fd0e0a00640 1 -- 172.21.15.2:0/3719518625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc02ae60 con 0x7fd0e406d4c0 2024-05-14T15:16:07.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 -- 172.21.15.2:0/3719518625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 msgr2=0x7fd0e4160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 --2- 172.21.15.2:0/3719518625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4160870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0098a0 tx=0x7fd0dc02a150 comp rx=0 tx=0).stop 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 -- 172.21.15.2:0/3719518625 shutdown_connections 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 --2- 172.21.15.2:0/3719518625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4160870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 --2- 172.21.15.2:0/3719518625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e415c800 0x7fd0e406cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 -- 172.21.15.2:0/3719518625 >> 172.21.15.2:0/3719518625 conn(0x7fd0e40ce230 msgr2=0x7fd0e40ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 -- 172.21.15.2:0/3719518625 shutdown_connections 2024-05-14T15:16:07.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.914+0000 7fd0e9000640 1 -- 172.21.15.2:0/3719518625 wait complete. 2024-05-14T15:16:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.917+0000 7fd0e9000640 1 Processor -- start 2024-05-14T15:16:07.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.917+0000 7fd0e9000640 1 -- start start 2024-05-14T15:16:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.918+0000 7fd0e9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.918+0000 7fd0e9000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e40b0eb0 0x7fd0e41421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.918+0000 7fd0e9000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0e415c800 0x7fd0e40b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.918+0000 7fd0e9000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e406f9d0 con 0x7fd0e406d4c0 2024-05-14T15:16:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.918+0000 7fd0e9000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e40b5560 con 0x7fd0e415c800 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.918+0000 7fd0e9000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e40b51f0 con 0x7fd0e40b0eb0 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56916/0 (socket says 172.21.15.2:56916) 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 -- 172.21.15.2:0/1641353355 learned_addr learned my addr 172.21.15.2:0/1641353355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 -- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e40b0eb0 msgr2=0x7fd0e41421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e40b0eb0 0x7fd0e41421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 -- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0e415c800 msgr2=0x7fd0e40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e2800640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0e415c800 0x7fd0e40b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0e415c800 0x7fd0e40b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 -- 172.21.15.2:0/1641353355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e4149850 con 0x7fd0e406d4c0 2024-05-14T15:16:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.919+0000 7fd0e1e00640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4148f50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400d600 tx=0x7fd0d400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.920+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4004240 con 0x7fd0e406d4c0 2024-05-14T15:16:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.920+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40043e0 con 0x7fd0e406d4c0 2024-05-14T15:16:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.920+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003830 con 0x7fd0e406d4c0 2024-05-14T15:16:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.920+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e4151cd0 con 0x7fd0e406d4c0 2024-05-14T15:16:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.920+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e4152290 con 0x7fd0e406d4c0 2024-05-14T15:16:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.921+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e4050870 con 0x7fd0e406d4c0 2024-05-14T15:16:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.923+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd0d40039d0 con 0x7fd0e406d4c0 2024-05-14T15:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.924+0000 7fd0da000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd0c00762d0 0x7fd0c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.924+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd0d4097d80 con 0x7fd0e406d4c0 2024-05-14T15:16:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.924+0000 7fd0e1400640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd0c00762d0 0x7fd0c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:07.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.926+0000 7fd0e1400640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd0c00762d0 0x7fd0c00787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0e415cc10 tx=0x7fd0cc009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:07.929+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd0d4061270 con 0x7fd0e406d4c0 2024-05-14T15:16:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.181+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd0e406ddc0 con 0x7fd0e406d4c0 2024-05-14T15:16:08.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.583+0000 7fd0da000640 1 -- 172.21.15.2:0/1641353355 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fd0d4060b70 con 0x7fd0e406d4c0 2024-05-14T15:16:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.586+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd0c00762d0 msgr2=0x7fd0c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.586+0000 7fd0e9000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd0c00762d0 0x7fd0c00787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0e415cc10 tx=0x7fd0cc009250 comp rx=0 tx=0).stop 2024-05-14T15:16:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.586+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 msgr2=0x7fd0e4148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:08.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.586+0000 7fd0e9000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4148f50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400d600 tx=0x7fd0d400dac0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 shutdown_connections 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd0c00762d0 0x7fd0c00787e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0e415c800 0x7fd0e40b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0e40b0eb0 0x7fd0e41421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 --2- 172.21.15.2:0/1641353355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0e406d4c0 0x7fd0e4148f50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 >> 172.21.15.2:0/1641353355 conn(0x7fd0e40ce230 msgr2=0x7fd0e415ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 shutdown_connections 2024-05-14T15:16:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.587+0000 7fd0e9000640 1 -- 172.21.15.2:0/1641353355 wait complete. 2024-05-14T15:16:08.619 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T15:16:08.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.904+0000 7fa70d000640 1 Processor -- start 2024-05-14T15:16:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.905+0000 7fa70d000640 1 -- start start 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.906+0000 7fa70d000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa7080d1050 0x7fa708070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.906+0000 7fa70d000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa70806de10 0x7fa7080ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.906+0000 7fa70d000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7081618d0 con 0x7fa708070e80 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa70d000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa7081624e0 con 0x7fa7080d1050 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa70d000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa708161bb0 con 0x7fa70806de10 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa7080d1050 0x7fa708070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa7080d1050 0x7fa708070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56932/0 (socket says 172.21.15.2:56932) 2024-05-14T15:16:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 -- 172.21.15.2:0/3701894225 learned_addr learned my addr 172.21.15.2:0/3701894225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707e00640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa70806de10 0x7fa7080ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 -- 172.21.15.2:0/3701894225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa70806de10 msgr2=0x7fa7080ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa70806de10 0x7fa7080ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 -- 172.21.15.2:0/3701894225 >> v1:172.21.15.156:6789/0 conn(0x7fa708070e80 legacy=0x7fa70806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.907+0000 7fa707400640 1 -- 172.21.15.2:0/3701894225 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa708161e90 con 0x7fa7080d1050 2024-05-14T15:16:08.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.908+0000 7fa707e00640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa70806de10 0x7fa7080ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.909+0000 7fa707400640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7080d1050 0x7fa708070940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009e50 tx=0x7fa6f802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93af7b917d20141 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.909+0000 7fa706000640 1 -- 172.21.15.2:0/3701894225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8036070 con 0x7fa7080d1050 2024-05-14T15:16:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.909+0000 7fa706000640 1 -- 172.21.15.2:0/3701894225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8031600 con 0x7fa7080d1050 2024-05-14T15:16:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.909+0000 7fa706000640 1 -- 172.21.15.2:0/3701894225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80319d0 con 0x7fa7080d1050 2024-05-14T15:16:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 -- 172.21.15.2:0/3701894225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7080d1050 msgr2=0x7fa708070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7080d1050 0x7fa708070940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009e50 tx=0x7fa6f802a680 comp rx=0 tx=0).stop 2024-05-14T15:16:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 -- 172.21.15.2:0/3701894225 shutdown_connections 2024-05-14T15:16:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa70806de10 0x7fa7080ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 --2- 172.21.15.2:0/3701894225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7080d1050 0x7fa708070940 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 -- 172.21.15.2:0/3701894225 >> 172.21.15.2:0/3701894225 conn(0x7fa7080732e0 msgr2=0x7fa7080736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 -- 172.21.15.2:0/3701894225 shutdown_connections 2024-05-14T15:16:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.910+0000 7fa70d000640 1 -- 172.21.15.2:0/3701894225 wait complete. 2024-05-14T15:16:08.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.912+0000 7fa70d000640 1 Processor -- start 2024-05-14T15:16:08.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.913+0000 7fa70d000640 1 -- start start 2024-05-14T15:16:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.914+0000 7fa70d000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa708070e80 0x7fa70815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.914+0000 7fa70d000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7080d1050 0x7fa7081f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.914+0000 7fa70d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 0x7fa708159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.914+0000 7fa70d000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa70815f290 con 0x7fa708155310 2024-05-14T15:16:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.914+0000 7fa70d000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa70815f110 con 0x7fa708070e80 2024-05-14T15:16:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.914+0000 7fa70d000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa7080aec90 con 0x7fa7080d1050 2024-05-14T15:16:08.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 0x7fa708159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:08.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 0x7fa708159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56938/0 (socket says 172.21.15.2:56938) 2024-05-14T15:16:08.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 -- 172.21.15.2:0/252631725 learned_addr learned my addr 172.21.15.2:0/252631725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707400640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa708070e80 0x7fa70815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa706a00640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7080d1050 0x7fa7081f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 -- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7080d1050 msgr2=0x7fa7081f95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7080d1050 0x7fa7081f95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 -- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa708070e80 msgr2=0x7fa70815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa708070e80 0x7fa70815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707e00640 1 -- 172.21.15.2:0/252631725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7081fa490 con 0x7fa708155310 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.915+0000 7fa707400640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa708070e80 0x7fa70815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.916+0000 7fa707e00640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 0x7fa708159630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c5c0 tx=0x7fa70000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.916+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700015070 con 0x7fa708155310 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.916+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa700011820 con 0x7fa708155310 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.916+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700011c10 con 0x7fa708155310 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.916+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7081fa1b0 con 0x7fa708155310 2024-05-14T15:16:08.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.916+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa70815e1d0 con 0x7fa708155310 2024-05-14T15:16:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.917+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa708050870 con 0x7fa708155310 2024-05-14T15:16:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.919+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa700018070 con 0x7fa708155310 2024-05-14T15:16:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.920+0000 7fa6ff400640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa6e8076300 0x7fa6e8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.920+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa7000977d0 con 0x7fa708155310 2024-05-14T15:16:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.921+0000 7fa707400640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa6e8076300 0x7fa6e8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.922+0000 7fa707400640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa6e8076300 0x7fa6e8078810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8033000 tx=0x7fa6f8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:08.925+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa700060680 con 0x7fa708155310 2024-05-14T15:16:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.174+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7081f9f40 con 0x7fa708155310 2024-05-14T15:16:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.176+0000 7fa6ff400640 1 -- 172.21.15.2:0/252631725 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7fa700064980 con 0x7fa708155310 2024-05-14T15:16:09.178 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:09.178 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.178+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa6e8076300 msgr2=0x7fa6e8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.178+0000 7fa70d000640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa6e8076300 0x7fa6e8078810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8033000 tx=0x7fa6f8009000 comp rx=0 tx=0).stop 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.178+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 msgr2=0x7fa708159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.178+0000 7fa70d000640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 0x7fa708159630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c5c0 tx=0x7fa70000ca80 comp rx=0 tx=0).stop 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 shutdown_connections 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa6e8076300 0x7fa6e8078810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa708155310 0x7fa708159630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7080d1050 0x7fa7081f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 --2- 172.21.15.2:0/252631725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa708070e80 0x7fa70815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 >> 172.21.15.2:0/252631725 conn(0x7fa7080732e0 msgr2=0x7fa7080b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 shutdown_connections 2024-05-14T15:16:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.179+0000 7fa70d000640 1 -- 172.21.15.2:0/252631725 wait complete. 2024-05-14T15:16:09.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.494+0000 7fd57bc00640 1 Processor -- start 2024-05-14T15:16:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.494+0000 7fd57bc00640 1 -- start start 2024-05-14T15:16:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.496+0000 7fd57bc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd57bc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5740b4690 0x7fd574164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd57bc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5740b4e00 con 0x7fd574164860 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd57bc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd5740b50e0 con 0x7fd5740706e0 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd57bc00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fd5740b53c0 con 0x7fd5740b4690 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd579200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd579c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd574164860 0x7fd57406d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43354/0 (socket says 172.21.15.2:43354) 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd579c00640 1 -- 172.21.15.2:0/2601250077 learned_addr learned my addr 172.21.15.2:0/2601250077 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.497+0000 7fd573e00640 1 --2- 172.21.15.2:0/2601250077 >> v2:172.21.15.156:3300/0 conn(0x7fd5740b4690 0x7fd574164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.498+0000 7fd579200640 1 -- 172.21.15.2:0/2601250077 >> v2:172.21.15.156:3300/0 conn(0x7fd5740b4690 msgr2=0x7fd574164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.498+0000 7fd579200640 1 --2- 172.21.15.2:0/2601250077 >> v2:172.21.15.156:3300/0 conn(0x7fd5740b4690 0x7fd574164320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.498+0000 7fd579200640 1 -- 172.21.15.2:0/2601250077 >> v1:172.21.15.2:6789/0 conn(0x7fd574164860 legacy=0x7fd57406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.498+0000 7fd579200640 1 -- 172.21.15.2:0/2601250077 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd574163e00 con 0x7fd5740706e0 2024-05-14T15:16:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.498+0000 7fd573400640 1 -- 172.21.15.2:0/2601250077 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129163930 0 0) 0x7fd5740b4e00 con 0x7fd574164860 2024-05-14T15:16:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.499+0000 7fd579200640 1 --2- 172.21.15.2:0/2601250077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740706e0 0x7fd574160070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd574070da0 tx=0x7fd56402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ea370463ddee3b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.499+0000 7fd573400640 1 -- 172.21.15.2:0/2601250077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564037070 con 0x7fd5740706e0 2024-05-14T15:16:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.499+0000 7fd573400640 1 -- 172.21.15.2:0/2601250077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564032440 con 0x7fd5740706e0 2024-05-14T15:16:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.499+0000 7fd573400640 1 -- 172.21.15.2:0/2601250077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564032810 con 0x7fd5740706e0 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 -- 172.21.15.2:0/2601250077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740706e0 msgr2=0x7fd574160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 --2- 172.21.15.2:0/2601250077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740706e0 0x7fd574160070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd574070da0 tx=0x7fd56402a1a0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 -- 172.21.15.2:0/2601250077 shutdown_connections 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 --2- 172.21.15.2:0/2601250077 >> v2:172.21.15.156:3300/0 conn(0x7fd5740b4690 0x7fd574164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 --2- 172.21.15.2:0/2601250077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 -- 172.21.15.2:0/2601250077 >> 172.21.15.2:0/2601250077 conn(0x7fd5740d1d10 msgr2=0x7fd5740734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 -- 172.21.15.2:0/2601250077 shutdown_connections 2024-05-14T15:16:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.500+0000 7fd57bc00640 1 -- 172.21.15.2:0/2601250077 wait complete. 2024-05-14T15:16:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.503+0000 7fd57bc00640 1 Processor -- start 2024-05-14T15:16:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.503+0000 7fd57bc00640 1 -- start start 2024-05-14T15:16:09.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.504+0000 7fd57bc00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:09.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.504+0000 7fd57bc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 0x7fd5741471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:09.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.504+0000 7fd57bc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd574164860 0x7fd57415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:09.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.504+0000 7fd57bc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd57406df90 con 0x7fd5740b4690 2024-05-14T15:16:09.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.504+0000 7fd57bc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd57406de10 con 0x7fd574164860 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.504+0000 7fd57bc00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740af2d0 con 0x7fd5740706e0 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 0x7fd5741471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 0x7fd5741471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56960/0 (socket says 172.21.15.2:56960) 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 -- 172.21.15.2:0/589750613 learned_addr learned my addr 172.21.15.2:0/589750613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd579200640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd579c00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd574164860 0x7fd57415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 -- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5740706e0 msgr2=0x7fd574160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 -- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd574164860 msgr2=0x7fd57415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd574164860 0x7fd57415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.505+0000 7fd573e00640 1 -- 172.21.15.2:0/589750613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd574148650 con 0x7fd5740b4690 2024-05-14T15:16:09.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.506+0000 7fd573e00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 0x7fd5741471a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00d5f0 tx=0x7fd55c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:09.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.506+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c0125f0 con 0x7fd5740b4690 2024-05-14T15:16:09.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.506+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd55c019070 con 0x7fd5740b4690 2024-05-14T15:16:09.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.506+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c0129d0 con 0x7fd5740b4690 2024-05-14T15:16:09.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.506+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd574148930 con 0x7fd5740b4690 2024-05-14T15:16:09.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.506+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd574148ef0 con 0x7fd5740b4690 2024-05-14T15:16:09.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.507+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd574069b00 con 0x7fd5740b4690 2024-05-14T15:16:09.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.508+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd55c012b70 con 0x7fd5740b4690 2024-05-14T15:16:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.509+0000 7fd570c00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd5500762d0 0x7fd5500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.509+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd55c097e50 con 0x7fd5740b4690 2024-05-14T15:16:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.510+0000 7fd579200640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd5500762d0 0x7fd5500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.511+0000 7fd579200640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd5500762d0 0x7fd5500787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd564034000 tx=0x7fd56402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.514+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd574069b00 con 0x7fd5740b4690 2024-05-14T15:16:09.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.727+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd574050870 con 0x7fd5740b4690 2024-05-14T15:16:09.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.731+0000 7fd570c00640 1 -- 172.21.15.2:0/589750613 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7fd55c061340 con 0x7fd5740b4690 2024-05-14T15:16:09.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:09.731 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.733+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd5500762d0 msgr2=0x7fd5500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.733+0000 7fd57bc00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd5500762d0 0x7fd5500787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd564034000 tx=0x7fd56402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.733+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 msgr2=0x7fd5741471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.733+0000 7fd57bc00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 0x7fd5741471a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00d5f0 tx=0x7fd55c00dab0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 shutdown_connections 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd5500762d0 0x7fd5500787e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd574164860 0x7fd57415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5740b4690 0x7fd5741471a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 --2- 172.21.15.2:0/589750613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5740706e0 0x7fd574160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 >> 172.21.15.2:0/589750613 conn(0x7fd5740d1d10 msgr2=0x7fd5740b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 shutdown_connections 2024-05-14T15:16:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:09.734+0000 7fd57bc00640 1 -- 172.21.15.2:0/589750613 wait complete. 2024-05-14T15:16:09.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T15:16:09.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:16:10.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.047+0000 7f9423200640 1 Processor -- start 2024-05-14T15:16:10.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.047+0000 7f9423200640 1 -- start start 2024-05-14T15:16:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.050+0000 7f9423200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f942406d700 0x7f942406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.050+0000 7f9423200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94240ae750 0x7f94240aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.050+0000 7f9423200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942406e050 con 0x7f94240d1050 2024-05-14T15:16:10.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.050+0000 7f9423200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f94241624e0 con 0x7f94240ae750 2024-05-14T15:16:10.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.050+0000 7f9423200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f94241618d0 con 0x7f942406d700 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9422800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94240ae750 0x7f94240aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9421400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f942406d700 0x7f942406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9422800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94240ae750 0x7f94240aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58540/0 (socket says 172.21.15.2:58540) 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9422800640 1 -- 172.21.15.2:0/4093944235 learned_addr learned my addr 172.21.15.2:0/4093944235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9422800640 1 -- 172.21.15.2:0/4093944235 >> v2:172.21.15.156:3300/0 conn(0x7f942406d700 msgr2=0x7f942406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9422800640 1 --2- 172.21.15.2:0/4093944235 >> v2:172.21.15.156:3300/0 conn(0x7f942406d700 0x7f942406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.051+0000 7f9422800640 1 -- 172.21.15.2:0/4093944235 >> v1:172.21.15.156:6789/0 conn(0x7f94240d1050 legacy=0x7f9424070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.052+0000 7f9422800640 1 -- 172.21.15.2:0/4093944235 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424161bb0 con 0x7f94240ae750 2024-05-14T15:16:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.053+0000 7f9422800640 1 --2- 172.21.15.2:0/4093944235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f94240aeb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f942409faa0 tx=0x7f941c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82350097c2a20365 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.053+0000 7f9420a00640 1 -- 172.21.15.2:0/4093944235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c036070 con 0x7f94240ae750 2024-05-14T15:16:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.053+0000 7f9420a00640 1 -- 172.21.15.2:0/4093944235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c031600 con 0x7f94240ae750 2024-05-14T15:16:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.053+0000 7f9420a00640 1 -- 172.21.15.2:0/4093944235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c0319d0 con 0x7f94240ae750 2024-05-14T15:16:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 -- 172.21.15.2:0/4093944235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 msgr2=0x7f94240aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 --2- 172.21.15.2:0/4093944235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f94240aeb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f942409faa0 tx=0x7f941c02a730 comp rx=0 tx=0).stop 2024-05-14T15:16:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 -- 172.21.15.2:0/4093944235 shutdown_connections 2024-05-14T15:16:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 --2- 172.21.15.2:0/4093944235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f94240aeb60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 --2- 172.21.15.2:0/4093944235 >> v2:172.21.15.156:3300/0 conn(0x7f942406d700 0x7f942406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 -- 172.21.15.2:0/4093944235 >> 172.21.15.2:0/4093944235 conn(0x7f94240732e0 msgr2=0x7f94240736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 -- 172.21.15.2:0/4093944235 shutdown_connections 2024-05-14T15:16:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.054+0000 7f9423200640 1 -- 172.21.15.2:0/4093944235 wait complete. 2024-05-14T15:16:10.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.058+0000 7f9423200640 1 Processor -- start 2024-05-14T15:16:10.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.058+0000 7f9423200640 1 -- start start 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9423200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f942406d700 0x7f9424154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9423200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f9424153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9423200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94240d1050 0x7f94240b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9423200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9424071050 con 0x7f94240ae750 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9423200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9424162170 con 0x7f942406d700 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9423200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f942415f110 con 0x7f94240d1050 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9421400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f9424153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9421400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f9424153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58542/0 (socket says 172.21.15.2:58542) 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.060+0000 7f9421400640 1 -- 172.21.15.2:0/3679181819 learned_addr learned my addr 172.21.15.2:0/3679181819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421e00640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f942406d700 0x7f9424154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9422800640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94240d1050 0x7f94240b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421400640 1 -- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94240d1050 msgr2=0x7f94240b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421400640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94240d1050 0x7f94240b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421400640 1 -- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f942406d700 msgr2=0x7f9424154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421400640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f942406d700 0x7f9424154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421400640 1 -- 172.21.15.2:0/3679181819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424154d80 con 0x7f94240ae750 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9422800640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94240d1050 0x7f94240b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9421400640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f9424153eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f941000e870 tx=0x7f941000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410017070 con 0x7f94240ae750 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941000c940 con 0x7f94240ae750 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94240b4cb0 con 0x7f94240ae750 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.061+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941000cd30 con 0x7f94240ae750 2024-05-14T15:16:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.062+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94240b5270 con 0x7f94240ae750 2024-05-14T15:16:10.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.063+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9424050870 con 0x7f94240ae750 2024-05-14T15:16:10.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.064+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f941001a070 con 0x7f94240ae750 2024-05-14T15:16:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.066+0000 7f941a000640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f94040762d0 0x7f94040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.066+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f94100978e0 con 0x7f94240ae750 2024-05-14T15:16:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.067+0000 7f9421e00640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f94040762d0 0x7f94040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.068+0000 7f9421e00640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f94040762d0 0x7f94040787e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9424074f20 tx=0x7f9414009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:10.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.070+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9410060e60 con 0x7f94240ae750 2024-05-14T15:16:10.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:10.215 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.279+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94240b4a60 con 0x7f94040762d0 2024-05-14T15:16:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.296+0000 7f941a000640 1 -- 172.21.15.2:0/3679181819 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f94240b4a60 con 0x7f94040762d0 2024-05-14T15:16:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:10.301 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:16:10.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.300+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f94040762d0 msgr2=0x7f94040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.300+0000 7f9423200640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f94040762d0 0x7f94040787e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9424074f20 tx=0x7f9414009040 comp rx=0 tx=0).stop 2024-05-14T15:16:10.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 msgr2=0x7f9424153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f9424153eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f941000e870 tx=0x7f941000ec70 comp rx=0 tx=0).stop 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 shutdown_connections 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f94040762d0 0x7f94040787e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94240d1050 0x7f94240b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94240ae750 0x7f9424153eb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 --2- 172.21.15.2:0/3679181819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f942406d700 0x7f9424154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 >> 172.21.15.2:0/3679181819 conn(0x7f94240732e0 msgr2=0x7f942415f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 shutdown_connections 2024-05-14T15:16:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.301+0000 7f9423200640 1 -- 172.21.15.2:0/3679181819 wait complete. 2024-05-14T15:16:10.328 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-14T15:16:08.852292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":150,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244476,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730244,"statfs":{"total":773094113280,"available":772843769856,"internally_reserved":0,"allocated":3416064,"data_stored":2034928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006370"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501523+0000","last_change":"2024-05-14T15:15:42.417595+0000","last_active":"2024-05-14T15:15:48.501523+0000","last_peered":"2024-05-14T15:15:48.501523+0000","last_clean":"2024-05-14T15:15:48.501523+0000","last_became_active":"2024-05-14T15:15:42.417179+0000","last_became_peered":"2024-05-14T15:15:42.417179+0000","last_unstale":"2024-05-14T15:15:48.501523+0000","last_undegraded":"2024-05-14T15:15:48.501523+0000","last_fullsized":"2024-05-14T15:15:48.501523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:42:18.787349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498176+0000","last_change":"2024-05-14T15:15:43.457677+0000","last_active":"2024-05-14T15:15:48.498176+0000","last_peered":"2024-05-14T15:15:48.498176+0000","last_clean":"2024-05-14T15:15:48.498176+0000","last_became_active":"2024-05-14T15:15:43.452767+0000","last_became_peered":"2024-05-14T15:15:43.452767+0000","last_unstale":"2024-05-14T15:15:48.498176+0000","last_undegraded":"2024-05-14T15:15:48.498176+0000","last_fullsized":"2024-05-14T15:15:48.498176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623643+0000","last_change":"2024-05-14T15:15:47.495167+0000","last_active":"2024-05-14T15:15:48.623643+0000","last_peered":"2024-05-14T15:15:48.623643+0000","last_clean":"2024-05-14T15:15:48.623643+0000","last_became_active":"2024-05-14T15:15:47.492518+0000","last_became_peered":"2024-05-14T15:15:47.492518+0000","last_unstale":"2024-05-14T15:15:48.623643+0000","last_undegraded":"2024-05-14T15:15:48.623643+0000","last_fullsized":"2024-05-14T15:15:48.623643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:50.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498369+0000","last_change":"2024-05-14T15:15:42.422083+0000","last_active":"2024-05-14T15:15:48.498369+0000","last_peered":"2024-05-14T15:15:48.498369+0000","last_clean":"2024-05-14T15:15:48.498369+0000","last_became_active":"2024-05-14T15:15:42.421028+0000","last_became_peered":"2024-05-14T15:15:42.421028+0000","last_unstale":"2024-05-14T15:15:48.498369+0000","last_undegraded":"2024-05-14T15:15:48.498369+0000","last_fullsized":"2024-05-14T15:15:48.498369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500289+0000","last_change":"2024-05-14T15:15:43.453241+0000","last_active":"2024-05-14T15:15:48.500289+0000","last_peered":"2024-05-14T15:15:48.500289+0000","last_clean":"2024-05-14T15:15:48.500289+0000","last_became_active":"2024-05-14T15:15:43.452842+0000","last_became_peered":"2024-05-14T15:15:43.452842+0000","last_unstale":"2024-05-14T15:15:48.500289+0000","last_undegraded":"2024-05-14T15:15:48.500289+0000","last_fullsized":"2024-05-14T15:15:48.500289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717215+0000","last_change":"2024-05-14T15:15:47.482168+0000","last_active":"2024-05-14T15:15:49.717215+0000","last_peered":"2024-05-14T15:15:49.717215+0000","last_clean":"2024-05-14T15:15:49.717215+0000","last_became_active":"2024-05-14T15:15:47.481660+0000","last_became_peered":"2024-05-14T15:15:47.481660+0000","last_unstale":"2024-05-14T15:15:49.717215+0000","last_undegraded":"2024-05-14T15:15:49.717215+0000","last_fullsized":"2024-05-14T15:15:49.717215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:55.796237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720865+0000","last_change":"2024-05-14T15:15:42.422851+0000","last_active":"2024-05-14T15:15:49.720865+0000","last_peered":"2024-05-14T15:15:49.720865+0000","last_clean":"2024-05-14T15:15:49.720865+0000","last_became_active":"2024-05-14T15:15:42.422311+0000","last_became_peered":"2024-05-14T15:15:42.422311+0000","last_unstale":"2024-05-14T15:15:49.720865+0000","last_undegraded":"2024-05-14T15:15:49.720865+0000","last_fullsized":"2024-05-14T15:15:49.720865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:08.447140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716843+0000","last_change":"2024-05-14T15:15:43.463138+0000","last_active":"2024-05-14T15:15:49.716843+0000","last_peered":"2024-05-14T15:15:49.716843+0000","last_clean":"2024-05-14T15:15:49.716843+0000","last_became_active":"2024-05-14T15:15:43.462013+0000","last_became_peered":"2024-05-14T15:15:43.462013+0000","last_unstale":"2024-05-14T15:15:49.716843+0000","last_undegraded":"2024-05-14T15:15:49.716843+0000","last_fullsized":"2024-05-14T15:15:49.716843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718047+0000","last_change":"2024-05-14T15:15:47.484138+0000","last_active":"2024-05-14T15:15:49.718047+0000","last_peered":"2024-05-14T15:15:49.718047+0000","last_clean":"2024-05-14T15:15:49.718047+0000","last_became_active":"2024-05-14T15:15:47.481944+0000","last_became_peered":"2024-05-14T15:15:47.481944+0000","last_unstale":"2024-05-14T15:15:49.718047+0000","last_undegraded":"2024-05-14T15:15:49.718047+0000","last_fullsized":"2024-05-14T15:15:49.718047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:46.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720875+0000","last_change":"2024-05-14T15:15:42.417373+0000","last_active":"2024-05-14T15:15:49.720875+0000","last_peered":"2024-05-14T15:15:49.720875+0000","last_clean":"2024-05-14T15:15:49.720875+0000","last_became_active":"2024-05-14T15:15:42.414048+0000","last_became_peered":"2024-05-14T15:15:42.414048+0000","last_unstale":"2024-05-14T15:15:49.720875+0000","last_undegraded":"2024-05-14T15:15:49.720875+0000","last_fullsized":"2024-05-14T15:15:49.720875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494888+0000","last_change":"2024-05-14T15:15:43.451769+0000","last_active":"2024-05-14T15:15:48.494888+0000","last_peered":"2024-05-14T15:15:48.494888+0000","last_clean":"2024-05-14T15:15:48.494888+0000","last_became_active":"2024-05-14T15:15:43.451412+0000","last_became_peered":"2024-05-14T15:15:43.451412+0000","last_unstale":"2024-05-14T15:15:48.494888+0000","last_undegraded":"2024-05-14T15:15:48.494888+0000","last_fullsized":"2024-05-14T15:15:48.494888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:49.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717130+0000","last_change":"2024-05-14T15:15:47.487605+0000","last_active":"2024-05-14T15:15:49.717130+0000","last_peered":"2024-05-14T15:15:49.717130+0000","last_clean":"2024-05-14T15:15:49.717130+0000","last_became_active":"2024-05-14T15:15:47.487161+0000","last_became_peered":"2024-05-14T15:15:47.487161+0000","last_unstale":"2024-05-14T15:15:49.717130+0000","last_undegraded":"2024-05-14T15:15:49.717130+0000","last_fullsized":"2024-05-14T15:15:49.717130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:53.249398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495256+0000","last_change":"2024-05-14T15:15:43.449347+0000","last_active":"2024-05-14T15:15:48.495256+0000","last_peered":"2024-05-14T15:15:48.495256+0000","last_clean":"2024-05-14T15:15:48.495256+0000","last_became_active":"2024-05-14T15:15:43.449033+0000","last_became_peered":"2024-05-14T15:15:43.449033+0000","last_unstale":"2024-05-14T15:15:48.495256+0000","last_undegraded":"2024-05-14T15:15:48.495256+0000","last_fullsized":"2024-05-14T15:15:48.495256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:38.435167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494527+0000","last_change":"2024-05-14T15:15:42.428357+0000","last_active":"2024-05-14T15:15:48.494527+0000","last_peered":"2024-05-14T15:15:48.494527+0000","last_clean":"2024-05-14T15:15:48.494527+0000","last_became_active":"2024-05-14T15:15:42.427991+0000","last_became_peered":"2024-05-14T15:15:42.427991+0000","last_unstale":"2024-05-14T15:15:48.494527+0000","last_undegraded":"2024-05-14T15:15:48.494527+0000","last_fullsized":"2024-05-14T15:15:48.494527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494376+0000","last_change":"2024-05-14T15:15:47.491521+0000","last_active":"2024-05-14T15:15:48.494376+0000","last_peered":"2024-05-14T15:15:48.494376+0000","last_clean":"2024-05-14T15:15:48.494376+0000","last_became_active":"2024-05-14T15:15:47.483066+0000","last_became_peered":"2024-05-14T15:15:47.483066+0000","last_unstale":"2024-05-14T15:15:48.494376+0000","last_undegraded":"2024-05-14T15:15:48.494376+0000","last_fullsized":"2024-05-14T15:15:48.494376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:50:18.051718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624028+0000","last_change":"2024-05-14T15:15:43.455362+0000","last_active":"2024-05-14T15:15:48.624028+0000","last_peered":"2024-05-14T15:15:48.624028+0000","last_clean":"2024-05-14T15:15:48.624028+0000","last_became_active":"2024-05-14T15:15:43.455028+0000","last_became_peered":"2024-05-14T15:15:43.455028+0000","last_unstale":"2024-05-14T15:15:48.624028+0000","last_undegraded":"2024-05-14T15:15:48.624028+0000","last_fullsized":"2024-05-14T15:15:48.624028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660478+0000","last_change":"2024-05-14T15:15:42.423694+0000","last_active":"2024-05-14T15:15:48.660478+0000","last_peered":"2024-05-14T15:15:48.660478+0000","last_clean":"2024-05-14T15:15:48.660478+0000","last_became_active":"2024-05-14T15:15:42.423346+0000","last_became_peered":"2024-05-14T15:15:42.423346+0000","last_unstale":"2024-05-14T15:15:48.660478+0000","last_undegraded":"2024-05-14T15:15:48.660478+0000","last_fullsized":"2024-05-14T15:15:48.660478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718485+0000","last_change":"2024-05-14T15:15:47.478026+0000","last_active":"2024-05-14T15:15:49.718485+0000","last_peered":"2024-05-14T15:15:49.718485+0000","last_clean":"2024-05-14T15:15:49.718485+0000","last_became_active":"2024-05-14T15:15:47.477418+0000","last_became_peered":"2024-05-14T15:15:47.477418+0000","last_unstale":"2024-05-14T15:15:49.718485+0000","last_undegraded":"2024-05-14T15:15:49.718485+0000","last_fullsized":"2024-05-14T15:15:49.718485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:13.853465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496213+0000","last_change":"2024-05-14T15:15:43.449813+0000","last_active":"2024-05-14T15:15:48.496213+0000","last_peered":"2024-05-14T15:15:48.496213+0000","last_clean":"2024-05-14T15:15:48.496213+0000","last_became_active":"2024-05-14T15:15:43.449491+0000","last_became_peered":"2024-05-14T15:15:43.449491+0000","last_unstale":"2024-05-14T15:15:48.496213+0000","last_undegraded":"2024-05-14T15:15:48.496213+0000","last_fullsized":"2024-05-14T15:15:48.496213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:27.960966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500467+0000","last_change":"2024-05-14T15:15:42.410105+0000","last_active":"2024-05-14T15:15:48.500467+0000","last_peered":"2024-05-14T15:15:48.500467+0000","last_clean":"2024-05-14T15:15:48.500467+0000","last_became_active":"2024-05-14T15:15:42.409688+0000","last_became_peered":"2024-05-14T15:15:42.409688+0000","last_unstale":"2024-05-14T15:15:48.500467+0000","last_undegraded":"2024-05-14T15:15:48.500467+0000","last_fullsized":"2024-05-14T15:15:48.500467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:49.012575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625612+0000","last_change":"2024-05-14T15:15:47.494744+0000","last_active":"2024-05-14T15:15:48.625612+0000","last_peered":"2024-05-14T15:15:48.625612+0000","last_clean":"2024-05-14T15:15:48.625612+0000","last_became_active":"2024-05-14T15:15:47.494270+0000","last_became_peered":"2024-05-14T15:15:47.494270+0000","last_unstale":"2024-05-14T15:15:48.625612+0000","last_undegraded":"2024-05-14T15:15:48.625612+0000","last_fullsized":"2024-05-14T15:15:48.625612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:51.834016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493342+0000","last_change":"2024-05-14T15:15:43.439361+0000","last_active":"2024-05-14T15:15:48.493342+0000","last_peered":"2024-05-14T15:15:48.493342+0000","last_clean":"2024-05-14T15:15:48.493342+0000","last_became_active":"2024-05-14T15:15:43.438756+0000","last_became_peered":"2024-05-14T15:15:43.438756+0000","last_unstale":"2024-05-14T15:15:48.493342+0000","last_undegraded":"2024-05-14T15:15:48.493342+0000","last_fullsized":"2024-05-14T15:15:48.493342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.714906+0000","last_change":"2024-05-14T15:15:42.425311+0000","last_active":"2024-05-14T15:15:49.714906+0000","last_peered":"2024-05-14T15:15:49.714906+0000","last_clean":"2024-05-14T15:15:49.714906+0000","last_became_active":"2024-05-14T15:15:42.424936+0000","last_became_peered":"2024-05-14T15:15:42.424936+0000","last_unstale":"2024-05-14T15:15:49.714906+0000","last_undegraded":"2024-05-14T15:15:49.714906+0000","last_fullsized":"2024-05-14T15:15:49.714906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718624+0000","last_change":"2024-05-14T15:15:47.491770+0000","last_active":"2024-05-14T15:15:49.718624+0000","last_peered":"2024-05-14T15:15:49.718624+0000","last_clean":"2024-05-14T15:15:49.718624+0000","last_became_active":"2024-05-14T15:15:47.491142+0000","last_became_peered":"2024-05-14T15:15:47.491142+0000","last_unstale":"2024-05-14T15:15:49.718624+0000","last_undegraded":"2024-05-14T15:15:49.718624+0000","last_fullsized":"2024-05-14T15:15:49.718624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501015+0000","last_change":"2024-05-14T15:15:43.451792+0000","last_active":"2024-05-14T15:15:48.501015+0000","last_peered":"2024-05-14T15:15:48.501015+0000","last_clean":"2024-05-14T15:15:48.501015+0000","last_became_active":"2024-05-14T15:15:43.451516+0000","last_became_peered":"2024-05-14T15:15:43.451516+0000","last_unstale":"2024-05-14T15:15:48.501015+0000","last_undegraded":"2024-05-14T15:15:48.501015+0000","last_fullsized":"2024-05-14T15:15:48.501015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:14:36.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496509+0000","last_change":"2024-05-14T15:15:42.428657+0000","last_active":"2024-05-14T15:15:48.496509+0000","last_peered":"2024-05-14T15:15:48.496509+0000","last_clean":"2024-05-14T15:15:48.496509+0000","last_became_active":"2024-05-14T15:15:42.428310+0000","last_became_peered":"2024-05-14T15:15:42.428310+0000","last_unstale":"2024-05-14T15:15:48.496509+0000","last_undegraded":"2024-05-14T15:15:48.496509+0000","last_fullsized":"2024-05-14T15:15:48.496509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:46.764246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718337+0000","last_change":"2024-05-14T15:15:47.477836+0000","last_active":"2024-05-14T15:15:49.718337+0000","last_peered":"2024-05-14T15:15:49.718337+0000","last_clean":"2024-05-14T15:15:49.718337+0000","last_became_active":"2024-05-14T15:15:47.477251+0000","last_became_peered":"2024-05-14T15:15:47.477251+0000","last_unstale":"2024-05-14T15:15:49.718337+0000","last_undegraded":"2024-05-14T15:15:49.718337+0000","last_fullsized":"2024-05-14T15:15:49.718337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501525+0000","last_change":"2024-05-14T15:15:43.448073+0000","last_active":"2024-05-14T15:15:48.501525+0000","last_peered":"2024-05-14T15:15:48.501525+0000","last_clean":"2024-05-14T15:15:48.501525+0000","last_became_active":"2024-05-14T15:15:43.447739+0000","last_became_peered":"2024-05-14T15:15:43.447739+0000","last_unstale":"2024-05-14T15:15:48.501525+0000","last_undegraded":"2024-05-14T15:15:48.501525+0000","last_fullsized":"2024-05-14T15:15:48.501525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:23:43.903273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501466+0000","last_change":"2024-05-14T15:15:42.427140+0000","last_active":"2024-05-14T15:15:48.501466+0000","last_peered":"2024-05-14T15:15:48.501466+0000","last_clean":"2024-05-14T15:15:48.501466+0000","last_became_active":"2024-05-14T15:15:42.426707+0000","last_became_peered":"2024-05-14T15:15:42.426707+0000","last_unstale":"2024-05-14T15:15:48.501466+0000","last_undegraded":"2024-05-14T15:15:48.501466+0000","last_fullsized":"2024-05-14T15:15:48.501466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:03:25.685366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496063+0000","last_change":"2024-05-14T15:15:47.483414+0000","last_active":"2024-05-14T15:15:48.496063+0000","last_peered":"2024-05-14T15:15:48.496063+0000","last_clean":"2024-05-14T15:15:48.496063+0000","last_became_active":"2024-05-14T15:15:47.481887+0000","last_became_peered":"2024-05-14T15:15:47.481887+0000","last_unstale":"2024-05-14T15:15:48.496063+0000","last_undegraded":"2024-05-14T15:15:48.496063+0000","last_fullsized":"2024-05-14T15:15:48.496063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:19.741676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661238+0000","last_change":"2024-05-14T15:15:43.446652+0000","last_active":"2024-05-14T15:15:48.661238+0000","last_peered":"2024-05-14T15:15:48.661238+0000","last_clean":"2024-05-14T15:15:48.661238+0000","last_became_active":"2024-05-14T15:15:43.446198+0000","last_became_peered":"2024-05-14T15:15:43.446198+0000","last_unstale":"2024-05-14T15:15:48.661238+0000","last_undegraded":"2024-05-14T15:15:48.661238+0000","last_fullsized":"2024-05-14T15:15:48.661238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:20.926603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495856+0000","last_change":"2024-05-14T15:15:42.414654+0000","last_active":"2024-05-14T15:15:48.495856+0000","last_peered":"2024-05-14T15:15:48.495856+0000","last_clean":"2024-05-14T15:15:48.495856+0000","last_became_active":"2024-05-14T15:15:42.413985+0000","last_became_peered":"2024-05-14T15:15:42.413985+0000","last_unstale":"2024-05-14T15:15:48.495856+0000","last_undegraded":"2024-05-14T15:15:48.495856+0000","last_fullsized":"2024-05-14T15:15:48.495856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660214+0000","last_change":"2024-05-14T15:15:47.492068+0000","last_active":"2024-05-14T15:15:48.660214+0000","last_peered":"2024-05-14T15:15:48.660214+0000","last_clean":"2024-05-14T15:15:48.660214+0000","last_became_active":"2024-05-14T15:15:47.490448+0000","last_became_peered":"2024-05-14T15:15:47.490448+0000","last_unstale":"2024-05-14T15:15:48.660214+0000","last_undegraded":"2024-05-14T15:15:48.660214+0000","last_fullsized":"2024-05-14T15:15:48.660214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717513+0000","last_change":"2024-05-14T15:15:43.451337+0000","last_active":"2024-05-14T15:15:49.717513+0000","last_peered":"2024-05-14T15:15:49.717513+0000","last_clean":"2024-05-14T15:15:49.717513+0000","last_became_active":"2024-05-14T15:15:43.450311+0000","last_became_peered":"2024-05-14T15:15:43.450311+0000","last_unstale":"2024-05-14T15:15:49.717513+0000","last_undegraded":"2024-05-14T15:15:49.717513+0000","last_fullsized":"2024-05-14T15:15:49.717513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496817+0000","last_change":"2024-05-14T15:15:42.421741+0000","last_active":"2024-05-14T15:15:48.496817+0000","last_peered":"2024-05-14T15:15:48.496817+0000","last_clean":"2024-05-14T15:15:48.496817+0000","last_became_active":"2024-05-14T15:15:42.421312+0000","last_became_peered":"2024-05-14T15:15:42.421312+0000","last_unstale":"2024-05-14T15:15:48.496817+0000","last_undegraded":"2024-05-14T15:15:48.496817+0000","last_fullsized":"2024-05-14T15:15:48.496817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659797+0000","last_change":"2024-05-14T15:15:47.490863+0000","last_active":"2024-05-14T15:15:48.659797+0000","last_peered":"2024-05-14T15:15:48.659797+0000","last_clean":"2024-05-14T15:15:48.659797+0000","last_became_active":"2024-05-14T15:15:47.486549+0000","last_became_peered":"2024-05-14T15:15:47.486549+0000","last_unstale":"2024-05-14T15:15:48.659797+0000","last_undegraded":"2024-05-14T15:15:48.659797+0000","last_fullsized":"2024-05-14T15:15:48.659797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717975+0000","last_change":"2024-05-14T15:15:43.465531+0000","last_active":"2024-05-14T15:15:49.717975+0000","last_peered":"2024-05-14T15:15:49.717975+0000","last_clean":"2024-05-14T15:15:49.717975+0000","last_became_active":"2024-05-14T15:15:43.464373+0000","last_became_peered":"2024-05-14T15:15:43.464373+0000","last_unstale":"2024-05-14T15:15:49.717975+0000","last_undegraded":"2024-05-14T15:15:49.717975+0000","last_fullsized":"2024-05-14T15:15:49.717975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494929+0000","last_change":"2024-05-14T15:15:42.418453+0000","last_active":"2024-05-14T15:15:48.494929+0000","last_peered":"2024-05-14T15:15:48.494929+0000","last_clean":"2024-05-14T15:15:48.494929+0000","last_became_active":"2024-05-14T15:15:42.418059+0000","last_became_peered":"2024-05-14T15:15:42.418059+0000","last_unstale":"2024-05-14T15:15:48.494929+0000","last_undegraded":"2024-05-14T15:15:48.494929+0000","last_fullsized":"2024-05-14T15:15:48.494929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:32.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661174+0000","last_change":"2024-05-14T15:15:47.481831+0000","last_active":"2024-05-14T15:15:48.661174+0000","last_peered":"2024-05-14T15:15:48.661174+0000","last_clean":"2024-05-14T15:15:48.661174+0000","last_became_active":"2024-05-14T15:15:47.481346+0000","last_became_peered":"2024-05-14T15:15:47.481346+0000","last_unstale":"2024-05-14T15:15:48.661174+0000","last_undegraded":"2024-05-14T15:15:48.661174+0000","last_fullsized":"2024-05-14T15:15:48.661174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:00.730977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495341+0000","last_change":"2024-05-14T15:15:43.467579+0000","last_active":"2024-05-14T15:15:48.495341+0000","last_peered":"2024-05-14T15:15:48.495341+0000","last_clean":"2024-05-14T15:15:48.495341+0000","last_became_active":"2024-05-14T15:15:43.454366+0000","last_became_peered":"2024-05-14T15:15:43.454366+0000","last_unstale":"2024-05-14T15:15:48.495341+0000","last_undegraded":"2024-05-14T15:15:48.495341+0000","last_fullsized":"2024-05-14T15:15:48.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624009+0000","last_change":"2024-05-14T15:15:42.420082+0000","last_active":"2024-05-14T15:15:48.624009+0000","last_peered":"2024-05-14T15:15:48.624009+0000","last_clean":"2024-05-14T15:15:48.624009+0000","last_became_active":"2024-05-14T15:15:42.418989+0000","last_became_peered":"2024-05-14T15:15:42.418989+0000","last_unstale":"2024-05-14T15:15:48.624009+0000","last_undegraded":"2024-05-14T15:15:48.624009+0000","last_fullsized":"2024-05-14T15:15:48.624009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660851+0000","last_change":"2024-05-14T15:15:47.486116+0000","last_active":"2024-05-14T15:15:48.660851+0000","last_peered":"2024-05-14T15:15:48.660851+0000","last_clean":"2024-05-14T15:15:48.660851+0000","last_became_active":"2024-05-14T15:15:47.485631+0000","last_became_peered":"2024-05-14T15:15:47.485631+0000","last_unstale":"2024-05-14T15:15:48.660851+0000","last_undegraded":"2024-05-14T15:15:48.660851+0000","last_fullsized":"2024-05-14T15:15:48.660851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:18.678917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659639+0000","last_change":"2024-05-14T15:15:43.457783+0000","last_active":"2024-05-14T15:15:48.659639+0000","last_peered":"2024-05-14T15:15:48.659639+0000","last_clean":"2024-05-14T15:15:48.659639+0000","last_became_active":"2024-05-14T15:15:43.457467+0000","last_became_peered":"2024-05-14T15:15:43.457467+0000","last_unstale":"2024-05-14T15:15:48.659639+0000","last_undegraded":"2024-05-14T15:15:48.659639+0000","last_fullsized":"2024-05-14T15:15:48.659639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:46.016672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493577+0000","last_change":"2024-05-14T15:15:42.420702+0000","last_active":"2024-05-14T15:15:48.493577+0000","last_peered":"2024-05-14T15:15:48.493577+0000","last_clean":"2024-05-14T15:15:48.493577+0000","last_became_active":"2024-05-14T15:15:42.420368+0000","last_became_peered":"2024-05-14T15:15:42.420368+0000","last_unstale":"2024-05-14T15:15:48.493577+0000","last_undegraded":"2024-05-14T15:15:48.493577+0000","last_fullsized":"2024-05-14T15:15:48.493577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:19.912181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497528+0000","last_change":"2024-05-14T15:15:47.494317+0000","last_active":"2024-05-14T15:15:48.497528+0000","last_peered":"2024-05-14T15:15:48.497528+0000","last_clean":"2024-05-14T15:15:48.497528+0000","last_became_active":"2024-05-14T15:15:47.493154+0000","last_became_peered":"2024-05-14T15:15:47.493154+0000","last_unstale":"2024-05-14T15:15:48.497528+0000","last_undegraded":"2024-05-14T15:15:48.497528+0000","last_fullsized":"2024-05-14T15:15:48.497528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:41.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498904+0000","last_change":"2024-05-14T15:15:43.443926+0000","last_active":"2024-05-14T15:15:48.498904+0000","last_peered":"2024-05-14T15:15:48.498904+0000","last_clean":"2024-05-14T15:15:48.498904+0000","last_became_active":"2024-05-14T15:15:43.443583+0000","last_became_peered":"2024-05-14T15:15:43.443583+0000","last_unstale":"2024-05-14T15:15:48.498904+0000","last_undegraded":"2024-05-14T15:15:48.498904+0000","last_fullsized":"2024-05-14T15:15:48.498904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:30.263461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494582+0000","last_change":"2024-05-14T15:15:42.425277+0000","last_active":"2024-05-14T15:15:48.494582+0000","last_peered":"2024-05-14T15:15:48.494582+0000","last_clean":"2024-05-14T15:15:48.494582+0000","last_became_active":"2024-05-14T15:15:42.424947+0000","last_became_peered":"2024-05-14T15:15:42.424947+0000","last_unstale":"2024-05-14T15:15:48.494582+0000","last_undegraded":"2024-05-14T15:15:48.494582+0000","last_fullsized":"2024-05-14T15:15:48.494582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716310+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:15:49.716310+0000","last_peered":"2024-05-14T15:15:49.716310+0000","last_clean":"2024-05-14T15:15:49.716310+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:15:49.716310+0000","last_undegraded":"2024-05-14T15:15:49.716310+0000","last_fullsized":"2024-05-14T15:15:49.716310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495545+0000","last_change":"2024-05-14T15:15:47.472173+0000","last_active":"2024-05-14T15:15:48.495545+0000","last_peered":"2024-05-14T15:15:48.495545+0000","last_clean":"2024-05-14T15:15:48.495545+0000","last_became_active":"2024-05-14T15:15:47.471697+0000","last_became_peered":"2024-05-14T15:15:47.471697+0000","last_unstale":"2024-05-14T15:15:48.495545+0000","last_undegraded":"2024-05-14T15:15:48.495545+0000","last_fullsized":"2024-05-14T15:15:48.495545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:52:45.119238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495230+0000","last_change":"2024-05-14T15:15:43.448608+0000","last_active":"2024-05-14T15:15:48.495230+0000","last_peered":"2024-05-14T15:15:48.495230+0000","last_clean":"2024-05-14T15:15:48.495230+0000","last_became_active":"2024-05-14T15:15:43.448235+0000","last_became_peered":"2024-05-14T15:15:43.448235+0000","last_unstale":"2024-05-14T15:15:48.495230+0000","last_undegraded":"2024-05-14T15:15:48.495230+0000","last_fullsized":"2024-05-14T15:15:48.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:00.533218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661459+0000","last_change":"2024-05-14T15:15:42.428026+0000","last_active":"2024-05-14T15:15:48.661459+0000","last_peered":"2024-05-14T15:15:48.661459+0000","last_clean":"2024-05-14T15:15:48.661459+0000","last_became_active":"2024-05-14T15:15:42.427537+0000","last_became_peered":"2024-05-14T15:15:42.427537+0000","last_unstale":"2024-05-14T15:15:48.661459+0000","last_undegraded":"2024-05-14T15:15:48.661459+0000","last_fullsized":"2024-05-14T15:15:48.661459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717385+0000","last_change":"2024-05-14T15:15:47.490170+0000","last_active":"2024-05-14T15:15:49.717385+0000","last_peered":"2024-05-14T15:15:49.717385+0000","last_clean":"2024-05-14T15:15:49.717385+0000","last_became_active":"2024-05-14T15:15:47.487824+0000","last_became_peered":"2024-05-14T15:15:47.487824+0000","last_unstale":"2024-05-14T15:15:49.717385+0000","last_undegraded":"2024-05-14T15:15:49.717385+0000","last_fullsized":"2024-05-14T15:15:49.717385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:49.464915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720510+0000","last_change":"2024-05-14T15:15:43.464058+0000","last_active":"2024-05-14T15:15:49.720510+0000","last_peered":"2024-05-14T15:15:49.720510+0000","last_clean":"2024-05-14T15:15:49.720510+0000","last_became_active":"2024-05-14T15:15:43.463701+0000","last_became_peered":"2024-05-14T15:15:43.463701+0000","last_unstale":"2024-05-14T15:15:49.720510+0000","last_undegraded":"2024-05-14T15:15:49.720510+0000","last_fullsized":"2024-05-14T15:15:49.720510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498005+0000","last_change":"2024-05-14T15:15:42.411298+0000","last_active":"2024-05-14T15:15:48.498005+0000","last_peered":"2024-05-14T15:15:48.498005+0000","last_clean":"2024-05-14T15:15:48.498005+0000","last_became_active":"2024-05-14T15:15:42.410793+0000","last_became_peered":"2024-05-14T15:15:42.410793+0000","last_unstale":"2024-05-14T15:15:48.498005+0000","last_undegraded":"2024-05-14T15:15:48.498005+0000","last_fullsized":"2024-05-14T15:15:48.498005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497076+0000","last_change":"2024-05-14T15:15:47.467300+0000","last_active":"2024-05-14T15:15:48.497076+0000","last_peered":"2024-05-14T15:15:48.497076+0000","last_clean":"2024-05-14T15:15:48.497076+0000","last_became_active":"2024-05-14T15:15:47.466741+0000","last_became_peered":"2024-05-14T15:15:47.466741+0000","last_unstale":"2024-05-14T15:15:48.497076+0000","last_undegraded":"2024-05-14T15:15:48.497076+0000","last_fullsized":"2024-05-14T15:15:48.497076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:53.743066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720754+0000","last_change":"2024-05-14T15:15:43.447908+0000","last_active":"2024-05-14T15:15:49.720754+0000","last_peered":"2024-05-14T15:15:49.720754+0000","last_clean":"2024-05-14T15:15:49.720754+0000","last_became_active":"2024-05-14T15:15:43.447571+0000","last_became_peered":"2024-05-14T15:15:43.447571+0000","last_unstale":"2024-05-14T15:15:49.720754+0000","last_undegraded":"2024-05-14T15:15:49.720754+0000","last_fullsized":"2024-05-14T15:15:49.720754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501459+0000","last_change":"2024-05-14T15:15:42.417527+0000","last_active":"2024-05-14T15:15:48.501459+0000","last_peered":"2024-05-14T15:15:48.501459+0000","last_clean":"2024-05-14T15:15:48.501459+0000","last_became_active":"2024-05-14T15:15:42.417147+0000","last_became_peered":"2024-05-14T15:15:42.417147+0000","last_unstale":"2024-05-14T15:15:48.501459+0000","last_undegraded":"2024-05-14T15:15:48.501459+0000","last_fullsized":"2024-05-14T15:15:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:56:23.532241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.492764+0000","last_change":"2024-05-14T15:15:47.474753+0000","last_active":"2024-05-14T15:15:48.492764+0000","last_peered":"2024-05-14T15:15:48.492764+0000","last_clean":"2024-05-14T15:15:48.492764+0000","last_became_active":"2024-05-14T15:15:47.471673+0000","last_became_peered":"2024-05-14T15:15:47.471673+0000","last_unstale":"2024-05-14T15:15:48.492764+0000","last_undegraded":"2024-05-14T15:15:48.492764+0000","last_fullsized":"2024-05-14T15:15:48.492764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:24:43.316754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718819+0000","last_change":"2024-05-14T15:15:43.466649+0000","last_active":"2024-05-14T15:15:49.718819+0000","last_peered":"2024-05-14T15:15:49.718819+0000","last_clean":"2024-05-14T15:15:49.718819+0000","last_became_active":"2024-05-14T15:15:43.466206+0000","last_became_peered":"2024-05-14T15:15:43.466206+0000","last_unstale":"2024-05-14T15:15:49.718819+0000","last_undegraded":"2024-05-14T15:15:49.718819+0000","last_fullsized":"2024-05-14T15:15:49.718819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720923+0000","last_change":"2024-05-14T15:15:42.423219+0000","last_active":"2024-05-14T15:15:49.720923+0000","last_peered":"2024-05-14T15:15:49.720923+0000","last_clean":"2024-05-14T15:15:49.720923+0000","last_became_active":"2024-05-14T15:15:42.419631+0000","last_became_peered":"2024-05-14T15:15:42.419631+0000","last_unstale":"2024-05-14T15:15:49.720923+0000","last_undegraded":"2024-05-14T15:15:49.720923+0000","last_fullsized":"2024-05-14T15:15:49.720923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715423+0000","last_change":"2024-05-14T15:15:47.467637+0000","last_active":"2024-05-14T15:15:49.715423+0000","last_peered":"2024-05-14T15:15:49.715423+0000","last_clean":"2024-05-14T15:15:49.715423+0000","last_became_active":"2024-05-14T15:15:47.467193+0000","last_became_peered":"2024-05-14T15:15:47.467193+0000","last_unstale":"2024-05-14T15:15:49.715423+0000","last_undegraded":"2024-05-14T15:15:49.715423+0000","last_fullsized":"2024-05-14T15:15:49.715423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:26.200001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493066+0000","last_change":"2024-05-14T15:15:43.452875+0000","last_active":"2024-05-14T15:15:48.493066+0000","last_peered":"2024-05-14T15:15:48.493066+0000","last_clean":"2024-05-14T15:15:48.493066+0000","last_became_active":"2024-05-14T15:15:43.451854+0000","last_became_peered":"2024-05-14T15:15:43.451854+0000","last_unstale":"2024-05-14T15:15:48.493066+0000","last_undegraded":"2024-05-14T15:15:48.493066+0000","last_fullsized":"2024-05-14T15:15:48.493066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:42.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496486+0000","last_change":"2024-05-14T15:15:42.415604+0000","last_active":"2024-05-14T15:15:48.496486+0000","last_peered":"2024-05-14T15:15:48.496486+0000","last_clean":"2024-05-14T15:15:48.496486+0000","last_became_active":"2024-05-14T15:15:42.415191+0000","last_became_peered":"2024-05-14T15:15:42.415191+0000","last_unstale":"2024-05-14T15:15:48.496486+0000","last_undegraded":"2024-05-14T15:15:48.496486+0000","last_fullsized":"2024-05-14T15:15:48.496486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:57:56.475764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498134+0000","last_change":"2024-05-14T15:15:47.479478+0000","last_active":"2024-05-14T15:15:48.498134+0000","last_peered":"2024-05-14T15:15:48.498134+0000","last_clean":"2024-05-14T15:15:48.498134+0000","last_became_active":"2024-05-14T15:15:47.479035+0000","last_became_peered":"2024-05-14T15:15:47.479035+0000","last_unstale":"2024-05-14T15:15:48.498134+0000","last_undegraded":"2024-05-14T15:15:48.498134+0000","last_fullsized":"2024-05-14T15:15:48.498134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:21.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716155+0000","last_change":"2024-05-14T15:15:43.428593+0000","last_active":"2024-05-14T15:15:49.716155+0000","last_peered":"2024-05-14T15:15:49.716155+0000","last_clean":"2024-05-14T15:15:49.716155+0000","last_became_active":"2024-05-14T15:15:43.427534+0000","last_became_peered":"2024-05-14T15:15:43.427534+0000","last_unstale":"2024-05-14T15:15:49.716155+0000","last_undegraded":"2024-05-14T15:15:49.716155+0000","last_fullsized":"2024-05-14T15:15:49.716155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715821+0000","last_change":"2024-05-14T15:15:42.422410+0000","last_active":"2024-05-14T15:15:49.715821+0000","last_peered":"2024-05-14T15:15:49.715821+0000","last_clean":"2024-05-14T15:15:49.715821+0000","last_became_active":"2024-05-14T15:15:42.422082+0000","last_became_peered":"2024-05-14T15:15:42.422082+0000","last_unstale":"2024-05-14T15:15:49.715821+0000","last_undegraded":"2024-05-14T15:15:49.715821+0000","last_fullsized":"2024-05-14T15:15:49.715821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500190+0000","last_change":"2024-05-14T15:15:47.484942+0000","last_active":"2024-05-14T15:15:48.500190+0000","last_peered":"2024-05-14T15:15:48.500190+0000","last_clean":"2024-05-14T15:15:48.500190+0000","last_became_active":"2024-05-14T15:15:47.484470+0000","last_became_peered":"2024-05-14T15:15:47.484470+0000","last_unstale":"2024-05-14T15:15:48.500190+0000","last_undegraded":"2024-05-14T15:15:48.500190+0000","last_fullsized":"2024-05-14T15:15:48.500190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:55:55.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494248+0000","last_change":"2024-05-14T15:15:43.453259+0000","last_active":"2024-05-14T15:15:48.494248+0000","last_peered":"2024-05-14T15:15:48.494248+0000","last_clean":"2024-05-14T15:15:48.494248+0000","last_became_active":"2024-05-14T15:15:43.452961+0000","last_became_peered":"2024-05-14T15:15:43.452961+0000","last_unstale":"2024-05-14T15:15:48.494248+0000","last_undegraded":"2024-05-14T15:15:48.494248+0000","last_fullsized":"2024-05-14T15:15:48.494248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:22.596094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494575+0000","last_change":"2024-05-14T15:15:42.421393+0000","last_active":"2024-05-14T15:15:48.494575+0000","last_peered":"2024-05-14T15:15:48.494575+0000","last_clean":"2024-05-14T15:15:48.494575+0000","last_became_active":"2024-05-14T15:15:42.420606+0000","last_became_peered":"2024-05-14T15:15:42.420606+0000","last_unstale":"2024-05-14T15:15:48.494575+0000","last_undegraded":"2024-05-14T15:15:48.494575+0000","last_fullsized":"2024-05-14T15:15:48.494575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:54.271748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660641+0000","last_change":"2024-05-14T15:15:47.487448+0000","last_active":"2024-05-14T15:15:48.660641+0000","last_peered":"2024-05-14T15:15:48.660641+0000","last_clean":"2024-05-14T15:15:48.660641+0000","last_became_active":"2024-05-14T15:15:47.487018+0000","last_became_peered":"2024-05-14T15:15:47.487018+0000","last_unstale":"2024-05-14T15:15:48.660641+0000","last_undegraded":"2024-05-14T15:15:48.660641+0000","last_fullsized":"2024-05-14T15:15:48.660641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:46.795075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660071+0000","last_change":"2024-05-14T15:15:43.471275+0000","last_active":"2024-05-14T15:15:48.660071+0000","last_peered":"2024-05-14T15:15:48.660071+0000","last_clean":"2024-05-14T15:15:48.660071+0000","last_became_active":"2024-05-14T15:15:43.469496+0000","last_became_peered":"2024-05-14T15:15:43.469496+0000","last_unstale":"2024-05-14T15:15:48.660071+0000","last_undegraded":"2024-05-14T15:15:48.660071+0000","last_fullsized":"2024-05-14T15:15:48.660071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624389+0000","last_change":"2024-05-14T15:15:42.427285+0000","last_active":"2024-05-14T15:15:48.624389+0000","last_peered":"2024-05-14T15:15:48.624389+0000","last_clean":"2024-05-14T15:15:48.624389+0000","last_became_active":"2024-05-14T15:15:42.426859+0000","last_became_peered":"2024-05-14T15:15:42.426859+0000","last_unstale":"2024-05-14T15:15:48.624389+0000","last_undegraded":"2024-05-14T15:15:48.624389+0000","last_fullsized":"2024-05-14T15:15:48.624389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495007+0000","last_change":"2024-05-14T15:15:47.490888+0000","last_active":"2024-05-14T15:15:48.495007+0000","last_peered":"2024-05-14T15:15:48.495007+0000","last_clean":"2024-05-14T15:15:48.495007+0000","last_became_active":"2024-05-14T15:15:47.482649+0000","last_became_peered":"2024-05-14T15:15:47.482649+0000","last_unstale":"2024-05-14T15:15:48.495007+0000","last_undegraded":"2024-05-14T15:15:48.495007+0000","last_fullsized":"2024-05-14T15:15:48.495007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:26.333915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720738+0000","last_change":"2024-05-14T15:15:43.452281+0000","last_active":"2024-05-14T15:15:49.720738+0000","last_peered":"2024-05-14T15:15:49.720738+0000","last_clean":"2024-05-14T15:15:49.720738+0000","last_became_active":"2024-05-14T15:15:43.446861+0000","last_became_peered":"2024-05-14T15:15:43.446861+0000","last_unstale":"2024-05-14T15:15:49.720738+0000","last_undegraded":"2024-05-14T15:15:49.720738+0000","last_fullsized":"2024-05-14T15:15:49.720738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:59.089651+0000","last_change":"2024-05-14T15:15:42.423989+0000","last_active":"2024-05-14T15:15:59.089651+0000","last_peered":"2024-05-14T15:15:59.089651+0000","last_clean":"2024-05-14T15:15:59.089651+0000","last_became_active":"2024-05-14T15:15:42.423577+0000","last_became_peered":"2024-05-14T15:15:42.423577+0000","last_unstale":"2024-05-14T15:15:59.089651+0000","last_undegraded":"2024-05-14T15:15:59.089651+0000","last_fullsized":"2024-05-14T15:15:59.089651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:04.149215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498558+0000","last_change":"2024-05-14T15:15:47.475619+0000","last_active":"2024-05-14T15:15:48.498558+0000","last_peered":"2024-05-14T15:15:48.498558+0000","last_clean":"2024-05-14T15:15:48.498558+0000","last_became_active":"2024-05-14T15:15:47.471644+0000","last_became_peered":"2024-05-14T15:15:47.471644+0000","last_unstale":"2024-05-14T15:15:48.498558+0000","last_undegraded":"2024-05-14T15:15:48.498558+0000","last_fullsized":"2024-05-14T15:15:48.498558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:20:14.327039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494104+0000","last_change":"2024-05-14T15:15:43.452445+0000","last_active":"2024-05-14T15:15:48.494104+0000","last_peered":"2024-05-14T15:15:48.494104+0000","last_clean":"2024-05-14T15:15:48.494104+0000","last_became_active":"2024-05-14T15:15:43.452110+0000","last_became_peered":"2024-05-14T15:15:43.452110+0000","last_unstale":"2024-05-14T15:15:48.494104+0000","last_undegraded":"2024-05-14T15:15:48.494104+0000","last_fullsized":"2024-05-14T15:15:48.494104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:58.112691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624967+0000","last_change":"2024-05-14T15:15:42.414691+0000","last_active":"2024-05-14T15:15:48.624967+0000","last_peered":"2024-05-14T15:15:48.624967+0000","last_clean":"2024-05-14T15:15:48.624967+0000","last_became_active":"2024-05-14T15:15:42.411431+0000","last_became_peered":"2024-05-14T15:15:42.411431+0000","last_unstale":"2024-05-14T15:15:48.624967+0000","last_undegraded":"2024-05-14T15:15:48.624967+0000","last_fullsized":"2024-05-14T15:15:48.624967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718327+0000","last_change":"2024-05-14T15:15:47.490431+0000","last_active":"2024-05-14T15:15:49.718327+0000","last_peered":"2024-05-14T15:15:49.718327+0000","last_clean":"2024-05-14T15:15:49.718327+0000","last_became_active":"2024-05-14T15:15:47.488871+0000","last_became_peered":"2024-05-14T15:15:47.488871+0000","last_unstale":"2024-05-14T15:15:49.718327+0000","last_undegraded":"2024-05-14T15:15:49.718327+0000","last_fullsized":"2024-05-14T15:15:49.718327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:36.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500537+0000","last_change":"2024-05-14T15:15:43.471432+0000","last_active":"2024-05-14T15:15:48.500537+0000","last_peered":"2024-05-14T15:15:48.500537+0000","last_clean":"2024-05-14T15:15:48.500537+0000","last_became_active":"2024-05-14T15:15:43.468506+0000","last_became_peered":"2024-05-14T15:15:43.468506+0000","last_unstale":"2024-05-14T15:15:48.500537+0000","last_undegraded":"2024-05-14T15:15:48.500537+0000","last_fullsized":"2024-05-14T15:15:48.500537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721397+0000","last_change":"2024-05-14T15:15:42.425352+0000","last_active":"2024-05-14T15:15:49.721397+0000","last_peered":"2024-05-14T15:15:49.721397+0000","last_clean":"2024-05-14T15:15:49.721397+0000","last_became_active":"2024-05-14T15:15:42.424788+0000","last_became_peered":"2024-05-14T15:15:42.424788+0000","last_unstale":"2024-05-14T15:15:49.721397+0000","last_undegraded":"2024-05-14T15:15:49.721397+0000","last_fullsized":"2024-05-14T15:15:49.721397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623638+0000","last_change":"2024-05-14T15:15:47.495775+0000","last_active":"2024-05-14T15:15:48.623638+0000","last_peered":"2024-05-14T15:15:48.623638+0000","last_clean":"2024-05-14T15:15:48.623638+0000","last_became_active":"2024-05-14T15:15:47.494949+0000","last_became_peered":"2024-05-14T15:15:47.494949+0000","last_unstale":"2024-05-14T15:15:48.623638+0000","last_undegraded":"2024-05-14T15:15:48.623638+0000","last_fullsized":"2024-05-14T15:15:48.623638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:24.981952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718767+0000","last_change":"2024-05-14T15:15:43.455269+0000","last_active":"2024-05-14T15:15:49.718767+0000","last_peered":"2024-05-14T15:15:49.718767+0000","last_clean":"2024-05-14T15:15:49.718767+0000","last_became_active":"2024-05-14T15:15:43.454902+0000","last_became_peered":"2024-05-14T15:15:43.454902+0000","last_unstale":"2024-05-14T15:15:49.718767+0000","last_undegraded":"2024-05-14T15:15:49.718767+0000","last_fullsized":"2024-05-14T15:15:49.718767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720229+0000","last_change":"2024-05-14T15:15:42.413462+0000","last_active":"2024-05-14T15:15:49.720229+0000","last_peered":"2024-05-14T15:15:49.720229+0000","last_clean":"2024-05-14T15:15:49.720229+0000","last_became_active":"2024-05-14T15:15:42.412838+0000","last_became_peered":"2024-05-14T15:15:42.412838+0000","last_unstale":"2024-05-14T15:15:49.720229+0000","last_undegraded":"2024-05-14T15:15:49.720229+0000","last_fullsized":"2024-05-14T15:15:49.720229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499953+0000","last_change":"2024-05-14T15:15:47.481470+0000","last_active":"2024-05-14T15:15:48.499953+0000","last_peered":"2024-05-14T15:15:48.499953+0000","last_clean":"2024-05-14T15:15:48.499953+0000","last_became_active":"2024-05-14T15:15:47.480935+0000","last_became_peered":"2024-05-14T15:15:47.480935+0000","last_unstale":"2024-05-14T15:15:48.499953+0000","last_undegraded":"2024-05-14T15:15:48.499953+0000","last_fullsized":"2024-05-14T15:15:48.499953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:27.398715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501300+0000","last_change":"2024-05-14T15:15:47.470190+0000","last_active":"2024-05-14T15:15:48.501300+0000","last_peered":"2024-05-14T15:15:48.501300+0000","last_clean":"2024-05-14T15:15:48.501300+0000","last_became_active":"2024-05-14T15:15:47.469486+0000","last_became_peered":"2024-05-14T15:15:47.469486+0000","last_unstale":"2024-05-14T15:15:48.501300+0000","last_undegraded":"2024-05-14T15:15:48.501300+0000","last_fullsized":"2024-05-14T15:15:48.501300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:02:29.447286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500142+0000","last_change":"2024-05-14T15:15:43.432186+0000","last_active":"2024-05-14T15:15:48.500142+0000","last_peered":"2024-05-14T15:15:48.500142+0000","last_clean":"2024-05-14T15:15:48.500142+0000","last_became_active":"2024-05-14T15:15:43.431075+0000","last_became_peered":"2024-05-14T15:15:43.431075+0000","last_unstale":"2024-05-14T15:15:48.500142+0000","last_undegraded":"2024-05-14T15:15:48.500142+0000","last_fullsized":"2024-05-14T15:15:48.500142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:57.608006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493573+0000","last_change":"2024-05-14T15:15:42.429681+0000","last_active":"2024-05-14T15:15:48.493573+0000","last_peered":"2024-05-14T15:15:48.493573+0000","last_clean":"2024-05-14T15:15:48.493573+0000","last_became_active":"2024-05-14T15:15:42.426654+0000","last_became_peered":"2024-05-14T15:15:42.426654+0000","last_unstale":"2024-05-14T15:15:48.493573+0000","last_undegraded":"2024-05-14T15:15:48.493573+0000","last_fullsized":"2024-05-14T15:15:48.493573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:21.130230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496123+0000","last_change":"2024-05-14T15:15:47.474072+0000","last_active":"2024-05-14T15:15:48.496123+0000","last_peered":"2024-05-14T15:15:48.496123+0000","last_clean":"2024-05-14T15:15:48.496123+0000","last_became_active":"2024-05-14T15:15:47.473621+0000","last_became_peered":"2024-05-14T15:15:47.473621+0000","last_unstale":"2024-05-14T15:15:48.496123+0000","last_undegraded":"2024-05-14T15:15:48.496123+0000","last_fullsized":"2024-05-14T15:15:48.496123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:49.410071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495656+0000","last_change":"2024-05-14T15:15:43.448709+0000","last_active":"2024-05-14T15:15:48.495656+0000","last_peered":"2024-05-14T15:15:48.495656+0000","last_clean":"2024-05-14T15:15:48.495656+0000","last_became_active":"2024-05-14T15:15:43.448068+0000","last_became_peered":"2024-05-14T15:15:43.448068+0000","last_unstale":"2024-05-14T15:15:48.495656+0000","last_undegraded":"2024-05-14T15:15:48.495656+0000","last_fullsized":"2024-05-14T15:15:48.495656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659737+0000","last_change":"2024-05-14T15:15:42.429751+0000","last_active":"2024-05-14T15:15:48.659737+0000","last_peered":"2024-05-14T15:15:48.659737+0000","last_clean":"2024-05-14T15:15:48.659737+0000","last_became_active":"2024-05-14T15:15:42.429380+0000","last_became_peered":"2024-05-14T15:15:42.429380+0000","last_unstale":"2024-05-14T15:15:48.659737+0000","last_undegraded":"2024-05-14T15:15:48.659737+0000","last_fullsized":"2024-05-14T15:15:48.659737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494212+0000","last_change":"2024-05-14T15:15:42.428978+0000","last_active":"2024-05-14T15:15:48.494212+0000","last_peered":"2024-05-14T15:15:48.494212+0000","last_clean":"2024-05-14T15:15:48.494212+0000","last_became_active":"2024-05-14T15:15:42.428627+0000","last_became_peered":"2024-05-14T15:15:42.428627+0000","last_unstale":"2024-05-14T15:15:48.494212+0000","last_undegraded":"2024-05-14T15:15:48.494212+0000","last_fullsized":"2024-05-14T15:15:48.494212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:05.667253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499610+0000","last_change":"2024-05-14T15:15:43.447982+0000","last_active":"2024-05-14T15:15:48.499610+0000","last_peered":"2024-05-14T15:15:48.499610+0000","last_clean":"2024-05-14T15:15:48.499610+0000","last_became_active":"2024-05-14T15:15:43.446590+0000","last_became_peered":"2024-05-14T15:15:43.446590+0000","last_unstale":"2024-05-14T15:15:48.499610+0000","last_undegraded":"2024-05-14T15:15:48.499610+0000","last_fullsized":"2024-05-14T15:15:48.499610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:05.808230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499664+0000","last_change":"2024-05-14T15:15:47.488195+0000","last_active":"2024-05-14T15:15:48.499664+0000","last_peered":"2024-05-14T15:15:48.499664+0000","last_clean":"2024-05-14T15:15:48.499664+0000","last_became_active":"2024-05-14T15:15:47.487122+0000","last_became_peered":"2024-05-14T15:15:47.487122+0000","last_unstale":"2024-05-14T15:15:48.499664+0000","last_undegraded":"2024-05-14T15:15:48.499664+0000","last_fullsized":"2024-05-14T15:15:48.499664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:10:11.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499154+0000","last_change":"2024-05-14T15:15:42.420415+0000","last_active":"2024-05-14T15:15:48.499154+0000","last_peered":"2024-05-14T15:15:48.499154+0000","last_clean":"2024-05-14T15:15:48.499154+0000","last_became_active":"2024-05-14T15:15:42.420023+0000","last_became_peered":"2024-05-14T15:15:42.420023+0000","last_unstale":"2024-05-14T15:15:48.499154+0000","last_undegraded":"2024-05-14T15:15:48.499154+0000","last_fullsized":"2024-05-14T15:15:48.499154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717100+0000","last_change":"2024-05-14T15:15:43.442403+0000","last_active":"2024-05-14T15:15:49.717100+0000","last_peered":"2024-05-14T15:15:49.717100+0000","last_clean":"2024-05-14T15:15:49.717100+0000","last_became_active":"2024-05-14T15:15:43.442018+0000","last_became_peered":"2024-05-14T15:15:43.442018+0000","last_unstale":"2024-05-14T15:15:49.717100+0000","last_undegraded":"2024-05-14T15:15:49.717100+0000","last_fullsized":"2024-05-14T15:15:49.717100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624856+0000","last_change":"2024-05-14T15:15:47.484476+0000","last_active":"2024-05-14T15:15:48.624856+0000","last_peered":"2024-05-14T15:15:48.624856+0000","last_clean":"2024-05-14T15:15:48.624856+0000","last_became_active":"2024-05-14T15:15:47.483990+0000","last_became_peered":"2024-05-14T15:15:47.483990+0000","last_unstale":"2024-05-14T15:15:48.624856+0000","last_undegraded":"2024-05-14T15:15:48.624856+0000","last_fullsized":"2024-05-14T15:15:48.624856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:44.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717437+0000","last_change":"2024-05-14T15:15:43.452753+0000","last_active":"2024-05-14T15:15:49.717437+0000","last_peered":"2024-05-14T15:15:49.717437+0000","last_clean":"2024-05-14T15:15:49.717437+0000","last_became_active":"2024-05-14T15:15:43.450752+0000","last_became_peered":"2024-05-14T15:15:43.450752+0000","last_unstale":"2024-05-14T15:15:49.717437+0000","last_undegraded":"2024-05-14T15:15:49.717437+0000","last_fullsized":"2024-05-14T15:15:49.717437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623679+0000","last_change":"2024-05-14T15:15:43.459094+0000","last_active":"2024-05-14T15:15:48.623679+0000","last_peered":"2024-05-14T15:15:48.623679+0000","last_clean":"2024-05-14T15:15:48.623679+0000","last_became_active":"2024-05-14T15:15:43.458723+0000","last_became_peered":"2024-05-14T15:15:43.458723+0000","last_unstale":"2024-05-14T15:15:48.623679+0000","last_undegraded":"2024-05-14T15:15:48.623679+0000","last_fullsized":"2024-05-14T15:15:48.623679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493568+0000","last_change":"2024-05-14T15:15:43.446191+0000","last_active":"2024-05-14T15:15:48.493568+0000","last_peered":"2024-05-14T15:15:48.493568+0000","last_clean":"2024-05-14T15:15:48.493568+0000","last_became_active":"2024-05-14T15:15:43.445883+0000","last_became_peered":"2024-05-14T15:15:43.445883+0000","last_unstale":"2024-05-14T15:15:48.493568+0000","last_undegraded":"2024-05-14T15:15:48.493568+0000","last_fullsized":"2024-05-14T15:15:48.493568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:09.798116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497390+0000","last_change":"2024-05-14T15:15:43.462772+0000","last_active":"2024-05-14T15:15:48.497390+0000","last_peered":"2024-05-14T15:15:48.497390+0000","last_clean":"2024-05-14T15:15:48.497390+0000","last_became_active":"2024-05-14T15:15:43.458133+0000","last_became_peered":"2024-05-14T15:15:43.458133+0000","last_unstale":"2024-05-14T15:15:48.497390+0000","last_undegraded":"2024-05-14T15:15:48.497390+0000","last_fullsized":"2024-05-14T15:15:48.497390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660954+0000","last_change":"2024-05-14T15:15:43.464641+0000","last_active":"2024-05-14T15:15:48.660954+0000","last_peered":"2024-05-14T15:15:48.660954+0000","last_clean":"2024-05-14T15:15:48.660954+0000","last_became_active":"2024-05-14T15:15:43.464263+0000","last_became_peered":"2024-05-14T15:15:43.464263+0000","last_unstale":"2024-05-14T15:15:48.660954+0000","last_undegraded":"2024-05-14T15:15:48.660954+0000","last_fullsized":"2024-05-14T15:15:48.660954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660941+0000","last_change":"2024-05-14T15:15:43.453266+0000","last_active":"2024-05-14T15:15:48.660941+0000","last_peered":"2024-05-14T15:15:48.660941+0000","last_clean":"2024-05-14T15:15:48.660941+0000","last_became_active":"2024-05-14T15:15:43.452641+0000","last_became_peered":"2024-05-14T15:15:43.452641+0000","last_unstale":"2024-05-14T15:15:48.660941+0000","last_undegraded":"2024-05-14T15:15:48.660941+0000","last_fullsized":"2024-05-14T15:15:48.660941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:22.144652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718639+0000","last_change":"2024-05-14T15:15:43.455928+0000","last_active":"2024-05-14T15:15:49.718639+0000","last_peered":"2024-05-14T15:15:49.718639+0000","last_clean":"2024-05-14T15:15:49.718639+0000","last_became_active":"2024-05-14T15:15:43.454949+0000","last_became_peered":"2024-05-14T15:15:43.454949+0000","last_unstale":"2024-05-14T15:15:49.718639+0000","last_undegraded":"2024-05-14T15:15:49.718639+0000","last_fullsized":"2024-05-14T15:15:49.718639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499982+0000","last_change":"2024-05-14T15:15:43.470552+0000","last_active":"2024-05-14T15:15:48.499982+0000","last_peered":"2024-05-14T15:15:48.499982+0000","last_clean":"2024-05-14T15:15:48.499982+0000","last_became_active":"2024-05-14T15:15:43.453144+0000","last_became_peered":"2024-05-14T15:15:43.453144+0000","last_unstale":"2024-05-14T15:15:48.499982+0000","last_undegraded":"2024-05-14T15:15:48.499982+0000","last_fullsized":"2024-05-14T15:15:48.499982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493251+0000","last_change":"2024-05-14T15:15:43.442622+0000","last_active":"2024-05-14T15:15:48.493251+0000","last_peered":"2024-05-14T15:15:48.493251+0000","last_clean":"2024-05-14T15:15:48.493251+0000","last_became_active":"2024-05-14T15:15:43.442296+0000","last_became_peered":"2024-05-14T15:15:43.442296+0000","last_unstale":"2024-05-14T15:15:48.493251+0000","last_undegraded":"2024-05-14T15:15:48.493251+0000","last_fullsized":"2024-05-14T15:15:48.493251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496080+0000","last_change":"2024-05-14T15:15:43.447439+0000","last_active":"2024-05-14T15:15:48.496080+0000","last_peered":"2024-05-14T15:15:48.496080+0000","last_clean":"2024-05-14T15:15:48.496080+0000","last_became_active":"2024-05-14T15:15:43.446137+0000","last_became_peered":"2024-05-14T15:15:43.446137+0000","last_unstale":"2024-05-14T15:15:48.496080+0000","last_undegraded":"2024-05-14T15:15:48.496080+0000","last_fullsized":"2024-05-14T15:15:48.496080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716730+0000","last_change":"2024-05-14T15:15:43.449082+0000","last_active":"2024-05-14T15:15:49.716730+0000","last_peered":"2024-05-14T15:15:49.716730+0000","last_clean":"2024-05-14T15:15:49.716730+0000","last_became_active":"2024-05-14T15:15:43.446819+0000","last_became_peered":"2024-05-14T15:15:43.446819+0000","last_unstale":"2024-05-14T15:15:49.716730+0000","last_undegraded":"2024-05-14T15:15:49.716730+0000","last_fullsized":"2024-05-14T15:15:49.716730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499241+0000","last_change":"2024-05-14T15:15:43.447350+0000","last_active":"2024-05-14T15:15:48.499241+0000","last_peered":"2024-05-14T15:15:48.499241+0000","last_clean":"2024-05-14T15:15:48.499241+0000","last_became_active":"2024-05-14T15:15:43.445520+0000","last_became_peered":"2024-05-14T15:15:43.445520+0000","last_unstale":"2024-05-14T15:15:48.499241+0000","last_undegraded":"2024-05-14T15:15:48.499241+0000","last_fullsized":"2024-05-14T15:15:48.499241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:59:26.779034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720137+0000","last_change":"2024-05-14T15:15:43.455780+0000","last_active":"2024-05-14T15:15:49.720137+0000","last_peered":"2024-05-14T15:15:49.720137+0000","last_clean":"2024-05-14T15:15:49.720137+0000","last_became_active":"2024-05-14T15:15:43.450530+0000","last_became_peered":"2024-05-14T15:15:43.450530+0000","last_unstale":"2024-05-14T15:15:49.720137+0000","last_undegraded":"2024-05-14T15:15:49.720137+0000","last_fullsized":"2024-05-14T15:15:49.720137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495537+0000","last_change":"2024-05-14T15:15:43.444694+0000","last_active":"2024-05-14T15:15:48.495537+0000","last_peered":"2024-05-14T15:15:48.495537+0000","last_clean":"2024-05-14T15:15:48.495537+0000","last_became_active":"2024-05-14T15:15:43.444051+0000","last_became_peered":"2024-05-14T15:15:43.444051+0000","last_unstale":"2024-05-14T15:15:48.495537+0000","last_undegraded":"2024-05-14T15:15:48.495537+0000","last_fullsized":"2024-05-14T15:15:48.495537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:37.310772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625143+0000","last_change":"2024-05-14T15:15:43.460795+0000","last_active":"2024-05-14T15:15:48.625143+0000","last_peered":"2024-05-14T15:15:48.625143+0000","last_clean":"2024-05-14T15:15:48.625143+0000","last_became_active":"2024-05-14T15:15:43.460482+0000","last_became_peered":"2024-05-14T15:15:43.460482+0000","last_unstale":"2024-05-14T15:15:48.625143+0000","last_undegraded":"2024-05-14T15:15:48.625143+0000","last_fullsized":"2024-05-14T15:15:48.625143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496414+0000","last_change":"2024-05-14T15:15:43.454445+0000","last_active":"2024-05-14T15:15:48.496414+0000","last_peered":"2024-05-14T15:15:48.496414+0000","last_clean":"2024-05-14T15:15:48.496414+0000","last_became_active":"2024-05-14T15:15:43.453963+0000","last_became_peered":"2024-05-14T15:15:43.453963+0000","last_unstale":"2024-05-14T15:15:48.496414+0000","last_undegraded":"2024-05-14T15:15:48.496414+0000","last_fullsized":"2024-05-14T15:15:48.496414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:17.114782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493224+0000","last_change":"2024-05-14T15:15:43.451680+0000","last_active":"2024-05-14T15:15:48.493224+0000","last_peered":"2024-05-14T15:15:48.493224+0000","last_clean":"2024-05-14T15:15:48.493224+0000","last_became_active":"2024-05-14T15:15:43.451213+0000","last_became_peered":"2024-05-14T15:15:43.451213+0000","last_unstale":"2024-05-14T15:15:48.493224+0000","last_undegraded":"2024-05-14T15:15:48.493224+0000","last_fullsized":"2024-05-14T15:15:48.493224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495636+0000","last_change":"2024-05-14T15:15:43.450048+0000","last_active":"2024-05-14T15:15:48.495636+0000","last_peered":"2024-05-14T15:15:48.495636+0000","last_clean":"2024-05-14T15:15:48.495636+0000","last_became_active":"2024-05-14T15:15:43.447077+0000","last_became_peered":"2024-05-14T15:15:43.447077+0000","last_unstale":"2024-05-14T15:15:48.495636+0000","last_undegraded":"2024-05-14T15:15:48.495636+0000","last_fullsized":"2024-05-14T15:15:48.495636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:44.172442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659777+0000","last_change":"2024-05-14T15:15:43.452199+0000","last_active":"2024-05-14T15:15:48.659777+0000","last_peered":"2024-05-14T15:15:48.659777+0000","last_clean":"2024-05-14T15:15:48.659777+0000","last_became_active":"2024-05-14T15:15:43.451112+0000","last_became_peered":"2024-05-14T15:15:43.451112+0000","last_unstale":"2024-05-14T15:15:48.659777+0000","last_undegraded":"2024-05-14T15:15:48.659777+0000","last_fullsized":"2024-05-14T15:15:48.659777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660603+0000","last_change":"2024-05-14T15:15:43.467060+0000","last_active":"2024-05-14T15:15:48.660603+0000","last_peered":"2024-05-14T15:15:48.660603+0000","last_clean":"2024-05-14T15:15:48.660603+0000","last_became_active":"2024-05-14T15:15:43.466622+0000","last_became_peered":"2024-05-14T15:15:43.466622+0000","last_unstale":"2024-05-14T15:15:48.660603+0000","last_undegraded":"2024-05-14T15:15:48.660603+0000","last_fullsized":"2024-05-14T15:15:48.660603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:40.234140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.719694+0000","last_change":"2024-05-14T15:15:43.457250+0000","last_active":"2024-05-14T15:15:49.719694+0000","last_peered":"2024-05-14T15:15:49.719694+0000","last_clean":"2024-05-14T15:15:49.719694+0000","last_became_active":"2024-05-14T15:15:43.456942+0000","last_became_peered":"2024-05-14T15:15:43.456942+0000","last_unstale":"2024-05-14T15:15:49.719694+0000","last_undegraded":"2024-05-14T15:15:49.719694+0000","last_fullsized":"2024-05-14T15:15:49.719694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720574+0000","last_change":"2024-05-14T15:15:43.457388+0000","last_active":"2024-05-14T15:15:49.720574+0000","last_peered":"2024-05-14T15:15:49.720574+0000","last_clean":"2024-05-14T15:15:49.720574+0000","last_became_active":"2024-05-14T15:15:43.457024+0000","last_became_peered":"2024-05-14T15:15:43.457024+0000","last_unstale":"2024-05-14T15:15:49.720574+0000","last_undegraded":"2024-05-14T15:15:49.720574+0000","last_fullsized":"2024-05-14T15:15:49.720574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721313+0000","last_change":"2024-05-14T15:15:43.455894+0000","last_active":"2024-05-14T15:15:49.721313+0000","last_peered":"2024-05-14T15:15:49.721313+0000","last_clean":"2024-05-14T15:15:49.721313+0000","last_became_active":"2024-05-14T15:15:43.455558+0000","last_became_peered":"2024-05-14T15:15:43.455558+0000","last_unstale":"2024-05-14T15:15:49.721313+0000","last_undegraded":"2024-05-14T15:15:49.721313+0000","last_fullsized":"2024-05-14T15:15:49.721313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720231+0000","last_change":"2024-05-14T15:15:43.466235+0000","last_active":"2024-05-14T15:15:49.720231+0000","last_peered":"2024-05-14T15:15:49.720231+0000","last_clean":"2024-05-14T15:15:49.720231+0000","last_became_active":"2024-05-14T15:15:43.465681+0000","last_became_peered":"2024-05-14T15:15:43.465681+0000","last_unstale":"2024-05-14T15:15:49.720231+0000","last_undegraded":"2024-05-14T15:15:49.720231+0000","last_fullsized":"2024-05-14T15:15:49.720231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496181+0000","last_change":"2024-05-14T15:15:43.450897+0000","last_active":"2024-05-14T15:15:48.496181+0000","last_peered":"2024-05-14T15:15:48.496181+0000","last_clean":"2024-05-14T15:15:48.496181+0000","last_became_active":"2024-05-14T15:15:43.450206+0000","last_became_peered":"2024-05-14T15:15:43.450206+0000","last_unstale":"2024-05-14T15:15:48.496181+0000","last_undegraded":"2024-05-14T15:15:48.496181+0000","last_fullsized":"2024-05-14T15:15:48.496181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715857+0000","last_change":"2024-05-14T15:15:43.456409+0000","last_active":"2024-05-14T15:15:49.715857+0000","last_peered":"2024-05-14T15:15:49.715857+0000","last_clean":"2024-05-14T15:15:49.715857+0000","last_became_active":"2024-05-14T15:15:43.448064+0000","last_became_peered":"2024-05-14T15:15:43.448064+0000","last_unstale":"2024-05-14T15:15:49.715857+0000","last_undegraded":"2024-05-14T15:15:49.715857+0000","last_fullsized":"2024-05-14T15:15:49.715857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717628+0000","last_change":"2024-05-14T15:15:43.448505+0000","last_active":"2024-05-14T15:15:49.717628+0000","last_peered":"2024-05-14T15:15:49.717628+0000","last_clean":"2024-05-14T15:15:49.717628+0000","last_became_active":"2024-05-14T15:15:43.448130+0000","last_became_peered":"2024-05-14T15:15:43.448130+0000","last_unstale":"2024-05-14T15:15:49.717628+0000","last_undegraded":"2024-05-14T15:15:49.717628+0000","last_fullsized":"2024-05-14T15:15:49.717628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717789+0000","last_change":"2024-05-14T15:15:43.441410+0000","last_active":"2024-05-14T15:15:49.717789+0000","last_peered":"2024-05-14T15:15:49.717789+0000","last_clean":"2024-05-14T15:15:49.717789+0000","last_became_active":"2024-05-14T15:15:43.440720+0000","last_became_peered":"2024-05-14T15:15:43.440720+0000","last_unstale":"2024-05-14T15:15:49.717789+0000","last_undegraded":"2024-05-14T15:15:49.717789+0000","last_fullsized":"2024-05-14T15:15:49.717789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717624+0000","last_change":"2024-05-14T15:15:43.449956+0000","last_active":"2024-05-14T15:15:49.717624+0000","last_peered":"2024-05-14T15:15:49.717624+0000","last_clean":"2024-05-14T15:15:49.717624+0000","last_became_active":"2024-05-14T15:15:43.449153+0000","last_became_peered":"2024-05-14T15:15:43.449153+0000","last_unstale":"2024-05-14T15:15:49.717624+0000","last_undegraded":"2024-05-14T15:15:49.717624+0000","last_fullsized":"2024-05-14T15:15:49.717624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497578+0000","last_change":"2024-05-14T15:15:43.431817+0000","last_active":"2024-05-14T15:15:48.497578+0000","last_peered":"2024-05-14T15:15:48.497578+0000","last_clean":"2024-05-14T15:15:48.497578+0000","last_became_active":"2024-05-14T15:15:43.431329+0000","last_became_peered":"2024-05-14T15:15:43.431329+0000","last_unstale":"2024-05-14T15:15:48.497578+0000","last_undegraded":"2024-05-14T15:15:48.497578+0000","last_fullsized":"2024-05-14T15:15:48.497578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497862+0000","last_change":"2024-05-14T15:15:43.453311+0000","last_active":"2024-05-14T15:15:48.497862+0000","last_peered":"2024-05-14T15:15:48.497862+0000","last_clean":"2024-05-14T15:15:48.497862+0000","last_became_active":"2024-05-14T15:15:43.449852+0000","last_became_peered":"2024-05-14T15:15:43.449852+0000","last_unstale":"2024-05-14T15:15:48.497862+0000","last_undegraded":"2024-05-14T15:15:48.497862+0000","last_fullsized":"2024-05-14T15:15:48.497862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720694+0000","last_change":"2024-05-14T15:15:43.468567+0000","last_active":"2024-05-14T15:15:49.720694+0000","last_peered":"2024-05-14T15:15:49.720694+0000","last_clean":"2024-05-14T15:15:49.720694+0000","last_became_active":"2024-05-14T15:15:43.468239+0000","last_became_peered":"2024-05-14T15:15:43.468239+0000","last_unstale":"2024-05-14T15:15:49.720694+0000","last_undegraded":"2024-05-14T15:15:49.720694+0000","last_fullsized":"2024-05-14T15:15:49.720694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":109456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":110128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:16:10.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:16:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.642+0000 7fb2e2000640 1 Processor -- start 2024-05-14T15:16:10.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.642+0000 7fb2e2000640 1 -- start start 2024-05-14T15:16:10.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e2000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2dc06d700 0x7fb2dc06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e2000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2dc0ae750 0x7fb2dc0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e2000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2dc06e050 con 0x7fb2dc0d1050 2024-05-14T15:16:10.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e2000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb2dc1624e0 con 0x7fb2dc0ae750 2024-05-14T15:16:10.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e2000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fb2dc1618d0 con 0x7fb2dc06d700 2024-05-14T15:16:10.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e0c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb2dc0d1050 0x7fb2dc070940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36736/0 (socket says 172.21.15.2:36736) 2024-05-14T15:16:10.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e0c00640 1 -- 172.21.15.2:0/1511703350 learned_addr learned my addr 172.21.15.2:0/1511703350 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:10.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.645+0000 7fb2e1600640 1 --2- 172.21.15.2:0/1511703350 >> v2:172.21.15.2:3300/0 conn(0x7fb2dc0ae750 0x7fb2dc0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2dbe00640 1 --2- 172.21.15.2:0/1511703350 >> v2:172.21.15.156:3300/0 conn(0x7fb2dc06d700 0x7fb2dc06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2db400640 1 -- 172.21.15.2:0/1511703350 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143143104 0 0) 0x7fb2cc001110 con 0x7fb2dc0d1050 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2db400640 1 -- 172.21.15.2:0/1511703350 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2c0003520 con 0x7fb2dc0d1050 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2e1600640 1 -- 172.21.15.2:0/1511703350 >> v2:172.21.15.156:3300/0 conn(0x7fb2dc06d700 msgr2=0x7fb2dc06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2e1600640 1 --2- 172.21.15.2:0/1511703350 >> v2:172.21.15.156:3300/0 conn(0x7fb2dc06d700 0x7fb2dc06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2e1600640 1 -- 172.21.15.2:0/1511703350 >> v1:172.21.15.2:6789/0 conn(0x7fb2dc0d1050 legacy=0x7fb2dc070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2e1600640 1 -- 172.21.15.2:0/1511703350 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc161bb0 con 0x7fb2dc0ae750 2024-05-14T15:16:10.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.646+0000 7fb2dbe00640 1 --2- 172.21.15.2:0/1511703350 >> v2:172.21.15.156:3300/0 conn(0x7fb2dc06d700 0x7fb2dc06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:10.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.647+0000 7fb2e1600640 1 --2- 172.21.15.2:0/1511703350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc0aeb60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc09faa0 tx=0x7fb2d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58bb9735a4c2b3d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:10.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2db400640 1 -- 172.21.15.2:0/1511703350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4037070 con 0x7fb2dc0ae750 2024-05-14T15:16:10.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2db400640 1 -- 172.21.15.2:0/1511703350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d4032440 con 0x7fb2dc0ae750 2024-05-14T15:16:10.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2db400640 1 -- 172.21.15.2:0/1511703350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4032810 con 0x7fb2dc0ae750 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2e2000640 1 -- 172.21.15.2:0/1511703350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 msgr2=0x7fb2dc0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2e2000640 1 --2- 172.21.15.2:0/1511703350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc0aeb60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc09faa0 tx=0x7fb2d402a1a0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2e2000640 1 -- 172.21.15.2:0/1511703350 shutdown_connections 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.648+0000 7fb2e2000640 1 --2- 172.21.15.2:0/1511703350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc0aeb60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.649+0000 7fb2e2000640 1 --2- 172.21.15.2:0/1511703350 >> v2:172.21.15.156:3300/0 conn(0x7fb2dc06d700 0x7fb2dc06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.649+0000 7fb2e2000640 1 -- 172.21.15.2:0/1511703350 >> 172.21.15.2:0/1511703350 conn(0x7fb2dc0732e0 msgr2=0x7fb2dc0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.649+0000 7fb2e2000640 1 -- 172.21.15.2:0/1511703350 shutdown_connections 2024-05-14T15:16:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.649+0000 7fb2e2000640 1 -- 172.21.15.2:0/1511703350 wait complete. 2024-05-14T15:16:10.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.651+0000 7fb2e2000640 1 Processor -- start 2024-05-14T15:16:10.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.651+0000 7fb2e2000640 1 -- start start 2024-05-14T15:16:10.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2e2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc06d700 0x7fb2dc0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2e2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc1f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2e2000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2dc0d1050 0x7fb2dc0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2e2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc071050 con 0x7fb2dc0ae750 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2e2000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc162170 con 0x7fb2dc06d700 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2e2000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb2dc15f110 con 0x7fb2dc0d1050 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2dbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc1f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2dbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc1f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58560/0 (socket says 172.21.15.2:58560) 2024-05-14T15:16:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.653+0000 7fb2dbe00640 1 -- 172.21.15.2:0/336553833 learned_addr learned my addr 172.21.15.2:0/336553833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:10.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2e0c00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc06d700 0x7fb2dc0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2e1600640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2dc0d1050 0x7fb2dc0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2dbe00640 1 -- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2dc0d1050 msgr2=0x7fb2dc0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2dbe00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2dc0d1050 0x7fb2dc0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2dbe00640 1 -- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc06d700 msgr2=0x7fb2dc0b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2dbe00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc06d700 0x7fb2dc0b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2dbe00640 1 -- 172.21.15.2:0/336553833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc0b6590 con 0x7fb2dc0ae750 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2dbe00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc1f6be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8007ef0 tx=0x7fb2c800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c801a070 con 0x7fb2dc0ae750 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c8003b90 con 0x7fb2dc0ae750 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.654+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc15cfd0 con 0x7fb2dc0ae750 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.655+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8004030 con 0x7fb2dc0ae750 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.655+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc15d590 con 0x7fb2dc0ae750 2024-05-14T15:16:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.656+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2dc0b0910 con 0x7fb2dc0ae750 2024-05-14T15:16:10.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.657+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2c801d070 con 0x7fb2dc0ae750 2024-05-14T15:16:10.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.658+0000 7fb2d8c00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2bc0762d0 0x7fb2bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:10.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.658+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb2c8097c30 con 0x7fb2dc0ae750 2024-05-14T15:16:10.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.659+0000 7fb2e0c00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2bc0762d0 0x7fb2bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.660+0000 7fb2e0c00640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2bc0762d0 0x7fb2bc0787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc005880 tx=0x7fb2cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:10.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.663+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2dc0b0910 con 0x7fb2dc0ae750 2024-05-14T15:16:10.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.879+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2dc050870 con 0x7fb2bc0762d0 2024-05-14T15:16:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.905+0000 7fb2d8c00640 1 -- 172.21.15.2:0/336553833 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fb2dc050870 con 0x7fb2bc0762d0 2024-05-14T15:16:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2bc0762d0 msgr2=0x7fb2bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2bc0762d0 0x7fb2bc0787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc005880 tx=0x7fb2cc009040 comp rx=0 tx=0).stop 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 msgr2=0x7fb2dc1f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc1f6be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8007ef0 tx=0x7fb2c800d4a0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 shutdown_connections 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2bc0762d0 0x7fb2bc0787e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2dc0d1050 0x7fb2dc0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc0ae750 0x7fb2dc1f6be0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 --2- 172.21.15.2:0/336553833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc06d700 0x7fb2dc0b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.911+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 >> 172.21.15.2:0/336553833 conn(0x7fb2dc0732e0 msgr2=0x7fb2dc0b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.912+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 shutdown_connections 2024-05-14T15:16:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:10.912+0000 7fb2e2000640 1 -- 172.21.15.2:0/336553833 wait complete. 2024-05-14T15:16:10.941 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-05-14T15:16:10.853618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":150,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244476,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730244,"statfs":{"total":773094113280,"available":772843769856,"internally_reserved":0,"allocated":3416064,"data_stored":2034928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006683"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501523+0000","last_change":"2024-05-14T15:15:42.417595+0000","last_active":"2024-05-14T15:15:48.501523+0000","last_peered":"2024-05-14T15:15:48.501523+0000","last_clean":"2024-05-14T15:15:48.501523+0000","last_became_active":"2024-05-14T15:15:42.417179+0000","last_became_peered":"2024-05-14T15:15:42.417179+0000","last_unstale":"2024-05-14T15:15:48.501523+0000","last_undegraded":"2024-05-14T15:15:48.501523+0000","last_fullsized":"2024-05-14T15:15:48.501523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:42:18.787349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498176+0000","last_change":"2024-05-14T15:15:43.457677+0000","last_active":"2024-05-14T15:15:48.498176+0000","last_peered":"2024-05-14T15:15:48.498176+0000","last_clean":"2024-05-14T15:15:48.498176+0000","last_became_active":"2024-05-14T15:15:43.452767+0000","last_became_peered":"2024-05-14T15:15:43.452767+0000","last_unstale":"2024-05-14T15:15:48.498176+0000","last_undegraded":"2024-05-14T15:15:48.498176+0000","last_fullsized":"2024-05-14T15:15:48.498176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623643+0000","last_change":"2024-05-14T15:15:47.495167+0000","last_active":"2024-05-14T15:15:48.623643+0000","last_peered":"2024-05-14T15:15:48.623643+0000","last_clean":"2024-05-14T15:15:48.623643+0000","last_became_active":"2024-05-14T15:15:47.492518+0000","last_became_peered":"2024-05-14T15:15:47.492518+0000","last_unstale":"2024-05-14T15:15:48.623643+0000","last_undegraded":"2024-05-14T15:15:48.623643+0000","last_fullsized":"2024-05-14T15:15:48.623643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:50.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498369+0000","last_change":"2024-05-14T15:15:42.422083+0000","last_active":"2024-05-14T15:15:48.498369+0000","last_peered":"2024-05-14T15:15:48.498369+0000","last_clean":"2024-05-14T15:15:48.498369+0000","last_became_active":"2024-05-14T15:15:42.421028+0000","last_became_peered":"2024-05-14T15:15:42.421028+0000","last_unstale":"2024-05-14T15:15:48.498369+0000","last_undegraded":"2024-05-14T15:15:48.498369+0000","last_fullsized":"2024-05-14T15:15:48.498369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500289+0000","last_change":"2024-05-14T15:15:43.453241+0000","last_active":"2024-05-14T15:15:48.500289+0000","last_peered":"2024-05-14T15:15:48.500289+0000","last_clean":"2024-05-14T15:15:48.500289+0000","last_became_active":"2024-05-14T15:15:43.452842+0000","last_became_peered":"2024-05-14T15:15:43.452842+0000","last_unstale":"2024-05-14T15:15:48.500289+0000","last_undegraded":"2024-05-14T15:15:48.500289+0000","last_fullsized":"2024-05-14T15:15:48.500289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717215+0000","last_change":"2024-05-14T15:15:47.482168+0000","last_active":"2024-05-14T15:15:49.717215+0000","last_peered":"2024-05-14T15:15:49.717215+0000","last_clean":"2024-05-14T15:15:49.717215+0000","last_became_active":"2024-05-14T15:15:47.481660+0000","last_became_peered":"2024-05-14T15:15:47.481660+0000","last_unstale":"2024-05-14T15:15:49.717215+0000","last_undegraded":"2024-05-14T15:15:49.717215+0000","last_fullsized":"2024-05-14T15:15:49.717215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:55.796237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720865+0000","last_change":"2024-05-14T15:15:42.422851+0000","last_active":"2024-05-14T15:15:49.720865+0000","last_peered":"2024-05-14T15:15:49.720865+0000","last_clean":"2024-05-14T15:15:49.720865+0000","last_became_active":"2024-05-14T15:15:42.422311+0000","last_became_peered":"2024-05-14T15:15:42.422311+0000","last_unstale":"2024-05-14T15:15:49.720865+0000","last_undegraded":"2024-05-14T15:15:49.720865+0000","last_fullsized":"2024-05-14T15:15:49.720865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:08.447140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716843+0000","last_change":"2024-05-14T15:15:43.463138+0000","last_active":"2024-05-14T15:15:49.716843+0000","last_peered":"2024-05-14T15:15:49.716843+0000","last_clean":"2024-05-14T15:15:49.716843+0000","last_became_active":"2024-05-14T15:15:43.462013+0000","last_became_peered":"2024-05-14T15:15:43.462013+0000","last_unstale":"2024-05-14T15:15:49.716843+0000","last_undegraded":"2024-05-14T15:15:49.716843+0000","last_fullsized":"2024-05-14T15:15:49.716843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718047+0000","last_change":"2024-05-14T15:15:47.484138+0000","last_active":"2024-05-14T15:15:49.718047+0000","last_peered":"2024-05-14T15:15:49.718047+0000","last_clean":"2024-05-14T15:15:49.718047+0000","last_became_active":"2024-05-14T15:15:47.481944+0000","last_became_peered":"2024-05-14T15:15:47.481944+0000","last_unstale":"2024-05-14T15:15:49.718047+0000","last_undegraded":"2024-05-14T15:15:49.718047+0000","last_fullsized":"2024-05-14T15:15:49.718047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:46.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720875+0000","last_change":"2024-05-14T15:15:42.417373+0000","last_active":"2024-05-14T15:15:49.720875+0000","last_peered":"2024-05-14T15:15:49.720875+0000","last_clean":"2024-05-14T15:15:49.720875+0000","last_became_active":"2024-05-14T15:15:42.414048+0000","last_became_peered":"2024-05-14T15:15:42.414048+0000","last_unstale":"2024-05-14T15:15:49.720875+0000","last_undegraded":"2024-05-14T15:15:49.720875+0000","last_fullsized":"2024-05-14T15:15:49.720875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494888+0000","last_change":"2024-05-14T15:15:43.451769+0000","last_active":"2024-05-14T15:15:48.494888+0000","last_peered":"2024-05-14T15:15:48.494888+0000","last_clean":"2024-05-14T15:15:48.494888+0000","last_became_active":"2024-05-14T15:15:43.451412+0000","last_became_peered":"2024-05-14T15:15:43.451412+0000","last_unstale":"2024-05-14T15:15:48.494888+0000","last_undegraded":"2024-05-14T15:15:48.494888+0000","last_fullsized":"2024-05-14T15:15:48.494888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:49.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717130+0000","last_change":"2024-05-14T15:15:47.487605+0000","last_active":"2024-05-14T15:15:49.717130+0000","last_peered":"2024-05-14T15:15:49.717130+0000","last_clean":"2024-05-14T15:15:49.717130+0000","last_became_active":"2024-05-14T15:15:47.487161+0000","last_became_peered":"2024-05-14T15:15:47.487161+0000","last_unstale":"2024-05-14T15:15:49.717130+0000","last_undegraded":"2024-05-14T15:15:49.717130+0000","last_fullsized":"2024-05-14T15:15:49.717130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:53.249398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495256+0000","last_change":"2024-05-14T15:15:43.449347+0000","last_active":"2024-05-14T15:15:48.495256+0000","last_peered":"2024-05-14T15:15:48.495256+0000","last_clean":"2024-05-14T15:15:48.495256+0000","last_became_active":"2024-05-14T15:15:43.449033+0000","last_became_peered":"2024-05-14T15:15:43.449033+0000","last_unstale":"2024-05-14T15:15:48.495256+0000","last_undegraded":"2024-05-14T15:15:48.495256+0000","last_fullsized":"2024-05-14T15:15:48.495256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:38.435167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494527+0000","last_change":"2024-05-14T15:15:42.428357+0000","last_active":"2024-05-14T15:15:48.494527+0000","last_peered":"2024-05-14T15:15:48.494527+0000","last_clean":"2024-05-14T15:15:48.494527+0000","last_became_active":"2024-05-14T15:15:42.427991+0000","last_became_peered":"2024-05-14T15:15:42.427991+0000","last_unstale":"2024-05-14T15:15:48.494527+0000","last_undegraded":"2024-05-14T15:15:48.494527+0000","last_fullsized":"2024-05-14T15:15:48.494527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494376+0000","last_change":"2024-05-14T15:15:47.491521+0000","last_active":"2024-05-14T15:15:48.494376+0000","last_peered":"2024-05-14T15:15:48.494376+0000","last_clean":"2024-05-14T15:15:48.494376+0000","last_became_active":"2024-05-14T15:15:47.483066+0000","last_became_peered":"2024-05-14T15:15:47.483066+0000","last_unstale":"2024-05-14T15:15:48.494376+0000","last_undegraded":"2024-05-14T15:15:48.494376+0000","last_fullsized":"2024-05-14T15:15:48.494376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:50:18.051718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624028+0000","last_change":"2024-05-14T15:15:43.455362+0000","last_active":"2024-05-14T15:15:48.624028+0000","last_peered":"2024-05-14T15:15:48.624028+0000","last_clean":"2024-05-14T15:15:48.624028+0000","last_became_active":"2024-05-14T15:15:43.455028+0000","last_became_peered":"2024-05-14T15:15:43.455028+0000","last_unstale":"2024-05-14T15:15:48.624028+0000","last_undegraded":"2024-05-14T15:15:48.624028+0000","last_fullsized":"2024-05-14T15:15:48.624028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660478+0000","last_change":"2024-05-14T15:15:42.423694+0000","last_active":"2024-05-14T15:15:48.660478+0000","last_peered":"2024-05-14T15:15:48.660478+0000","last_clean":"2024-05-14T15:15:48.660478+0000","last_became_active":"2024-05-14T15:15:42.423346+0000","last_became_peered":"2024-05-14T15:15:42.423346+0000","last_unstale":"2024-05-14T15:15:48.660478+0000","last_undegraded":"2024-05-14T15:15:48.660478+0000","last_fullsized":"2024-05-14T15:15:48.660478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718485+0000","last_change":"2024-05-14T15:15:47.478026+0000","last_active":"2024-05-14T15:15:49.718485+0000","last_peered":"2024-05-14T15:15:49.718485+0000","last_clean":"2024-05-14T15:15:49.718485+0000","last_became_active":"2024-05-14T15:15:47.477418+0000","last_became_peered":"2024-05-14T15:15:47.477418+0000","last_unstale":"2024-05-14T15:15:49.718485+0000","last_undegraded":"2024-05-14T15:15:49.718485+0000","last_fullsized":"2024-05-14T15:15:49.718485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:13.853465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496213+0000","last_change":"2024-05-14T15:15:43.449813+0000","last_active":"2024-05-14T15:15:48.496213+0000","last_peered":"2024-05-14T15:15:48.496213+0000","last_clean":"2024-05-14T15:15:48.496213+0000","last_became_active":"2024-05-14T15:15:43.449491+0000","last_became_peered":"2024-05-14T15:15:43.449491+0000","last_unstale":"2024-05-14T15:15:48.496213+0000","last_undegraded":"2024-05-14T15:15:48.496213+0000","last_fullsized":"2024-05-14T15:15:48.496213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:27.960966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500467+0000","last_change":"2024-05-14T15:15:42.410105+0000","last_active":"2024-05-14T15:15:48.500467+0000","last_peered":"2024-05-14T15:15:48.500467+0000","last_clean":"2024-05-14T15:15:48.500467+0000","last_became_active":"2024-05-14T15:15:42.409688+0000","last_became_peered":"2024-05-14T15:15:42.409688+0000","last_unstale":"2024-05-14T15:15:48.500467+0000","last_undegraded":"2024-05-14T15:15:48.500467+0000","last_fullsized":"2024-05-14T15:15:48.500467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:49.012575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625612+0000","last_change":"2024-05-14T15:15:47.494744+0000","last_active":"2024-05-14T15:15:48.625612+0000","last_peered":"2024-05-14T15:15:48.625612+0000","last_clean":"2024-05-14T15:15:48.625612+0000","last_became_active":"2024-05-14T15:15:47.494270+0000","last_became_peered":"2024-05-14T15:15:47.494270+0000","last_unstale":"2024-05-14T15:15:48.625612+0000","last_undegraded":"2024-05-14T15:15:48.625612+0000","last_fullsized":"2024-05-14T15:15:48.625612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:51.834016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493342+0000","last_change":"2024-05-14T15:15:43.439361+0000","last_active":"2024-05-14T15:15:48.493342+0000","last_peered":"2024-05-14T15:15:48.493342+0000","last_clean":"2024-05-14T15:15:48.493342+0000","last_became_active":"2024-05-14T15:15:43.438756+0000","last_became_peered":"2024-05-14T15:15:43.438756+0000","last_unstale":"2024-05-14T15:15:48.493342+0000","last_undegraded":"2024-05-14T15:15:48.493342+0000","last_fullsized":"2024-05-14T15:15:48.493342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.714906+0000","last_change":"2024-05-14T15:15:42.425311+0000","last_active":"2024-05-14T15:15:49.714906+0000","last_peered":"2024-05-14T15:15:49.714906+0000","last_clean":"2024-05-14T15:15:49.714906+0000","last_became_active":"2024-05-14T15:15:42.424936+0000","last_became_peered":"2024-05-14T15:15:42.424936+0000","last_unstale":"2024-05-14T15:15:49.714906+0000","last_undegraded":"2024-05-14T15:15:49.714906+0000","last_fullsized":"2024-05-14T15:15:49.714906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718624+0000","last_change":"2024-05-14T15:15:47.491770+0000","last_active":"2024-05-14T15:15:49.718624+0000","last_peered":"2024-05-14T15:15:49.718624+0000","last_clean":"2024-05-14T15:15:49.718624+0000","last_became_active":"2024-05-14T15:15:47.491142+0000","last_became_peered":"2024-05-14T15:15:47.491142+0000","last_unstale":"2024-05-14T15:15:49.718624+0000","last_undegraded":"2024-05-14T15:15:49.718624+0000","last_fullsized":"2024-05-14T15:15:49.718624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501015+0000","last_change":"2024-05-14T15:15:43.451792+0000","last_active":"2024-05-14T15:15:48.501015+0000","last_peered":"2024-05-14T15:15:48.501015+0000","last_clean":"2024-05-14T15:15:48.501015+0000","last_became_active":"2024-05-14T15:15:43.451516+0000","last_became_peered":"2024-05-14T15:15:43.451516+0000","last_unstale":"2024-05-14T15:15:48.501015+0000","last_undegraded":"2024-05-14T15:15:48.501015+0000","last_fullsized":"2024-05-14T15:15:48.501015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:14:36.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496509+0000","last_change":"2024-05-14T15:15:42.428657+0000","last_active":"2024-05-14T15:15:48.496509+0000","last_peered":"2024-05-14T15:15:48.496509+0000","last_clean":"2024-05-14T15:15:48.496509+0000","last_became_active":"2024-05-14T15:15:42.428310+0000","last_became_peered":"2024-05-14T15:15:42.428310+0000","last_unstale":"2024-05-14T15:15:48.496509+0000","last_undegraded":"2024-05-14T15:15:48.496509+0000","last_fullsized":"2024-05-14T15:15:48.496509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:46.764246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718337+0000","last_change":"2024-05-14T15:15:47.477836+0000","last_active":"2024-05-14T15:15:49.718337+0000","last_peered":"2024-05-14T15:15:49.718337+0000","last_clean":"2024-05-14T15:15:49.718337+0000","last_became_active":"2024-05-14T15:15:47.477251+0000","last_became_peered":"2024-05-14T15:15:47.477251+0000","last_unstale":"2024-05-14T15:15:49.718337+0000","last_undegraded":"2024-05-14T15:15:49.718337+0000","last_fullsized":"2024-05-14T15:15:49.718337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501525+0000","last_change":"2024-05-14T15:15:43.448073+0000","last_active":"2024-05-14T15:15:48.501525+0000","last_peered":"2024-05-14T15:15:48.501525+0000","last_clean":"2024-05-14T15:15:48.501525+0000","last_became_active":"2024-05-14T15:15:43.447739+0000","last_became_peered":"2024-05-14T15:15:43.447739+0000","last_unstale":"2024-05-14T15:15:48.501525+0000","last_undegraded":"2024-05-14T15:15:48.501525+0000","last_fullsized":"2024-05-14T15:15:48.501525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:23:43.903273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501466+0000","last_change":"2024-05-14T15:15:42.427140+0000","last_active":"2024-05-14T15:15:48.501466+0000","last_peered":"2024-05-14T15:15:48.501466+0000","last_clean":"2024-05-14T15:15:48.501466+0000","last_became_active":"2024-05-14T15:15:42.426707+0000","last_became_peered":"2024-05-14T15:15:42.426707+0000","last_unstale":"2024-05-14T15:15:48.501466+0000","last_undegraded":"2024-05-14T15:15:48.501466+0000","last_fullsized":"2024-05-14T15:15:48.501466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:03:25.685366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496063+0000","last_change":"2024-05-14T15:15:47.483414+0000","last_active":"2024-05-14T15:15:48.496063+0000","last_peered":"2024-05-14T15:15:48.496063+0000","last_clean":"2024-05-14T15:15:48.496063+0000","last_became_active":"2024-05-14T15:15:47.481887+0000","last_became_peered":"2024-05-14T15:15:47.481887+0000","last_unstale":"2024-05-14T15:15:48.496063+0000","last_undegraded":"2024-05-14T15:15:48.496063+0000","last_fullsized":"2024-05-14T15:15:48.496063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:19.741676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661238+0000","last_change":"2024-05-14T15:15:43.446652+0000","last_active":"2024-05-14T15:15:48.661238+0000","last_peered":"2024-05-14T15:15:48.661238+0000","last_clean":"2024-05-14T15:15:48.661238+0000","last_became_active":"2024-05-14T15:15:43.446198+0000","last_became_peered":"2024-05-14T15:15:43.446198+0000","last_unstale":"2024-05-14T15:15:48.661238+0000","last_undegraded":"2024-05-14T15:15:48.661238+0000","last_fullsized":"2024-05-14T15:15:48.661238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:20.926603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495856+0000","last_change":"2024-05-14T15:15:42.414654+0000","last_active":"2024-05-14T15:15:48.495856+0000","last_peered":"2024-05-14T15:15:48.495856+0000","last_clean":"2024-05-14T15:15:48.495856+0000","last_became_active":"2024-05-14T15:15:42.413985+0000","last_became_peered":"2024-05-14T15:15:42.413985+0000","last_unstale":"2024-05-14T15:15:48.495856+0000","last_undegraded":"2024-05-14T15:15:48.495856+0000","last_fullsized":"2024-05-14T15:15:48.495856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660214+0000","last_change":"2024-05-14T15:15:47.492068+0000","last_active":"2024-05-14T15:15:48.660214+0000","last_peered":"2024-05-14T15:15:48.660214+0000","last_clean":"2024-05-14T15:15:48.660214+0000","last_became_active":"2024-05-14T15:15:47.490448+0000","last_became_peered":"2024-05-14T15:15:47.490448+0000","last_unstale":"2024-05-14T15:15:48.660214+0000","last_undegraded":"2024-05-14T15:15:48.660214+0000","last_fullsized":"2024-05-14T15:15:48.660214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717513+0000","last_change":"2024-05-14T15:15:43.451337+0000","last_active":"2024-05-14T15:15:49.717513+0000","last_peered":"2024-05-14T15:15:49.717513+0000","last_clean":"2024-05-14T15:15:49.717513+0000","last_became_active":"2024-05-14T15:15:43.450311+0000","last_became_peered":"2024-05-14T15:15:43.450311+0000","last_unstale":"2024-05-14T15:15:49.717513+0000","last_undegraded":"2024-05-14T15:15:49.717513+0000","last_fullsized":"2024-05-14T15:15:49.717513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496817+0000","last_change":"2024-05-14T15:15:42.421741+0000","last_active":"2024-05-14T15:15:48.496817+0000","last_peered":"2024-05-14T15:15:48.496817+0000","last_clean":"2024-05-14T15:15:48.496817+0000","last_became_active":"2024-05-14T15:15:42.421312+0000","last_became_peered":"2024-05-14T15:15:42.421312+0000","last_unstale":"2024-05-14T15:15:48.496817+0000","last_undegraded":"2024-05-14T15:15:48.496817+0000","last_fullsized":"2024-05-14T15:15:48.496817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659797+0000","last_change":"2024-05-14T15:15:47.490863+0000","last_active":"2024-05-14T15:15:48.659797+0000","last_peered":"2024-05-14T15:15:48.659797+0000","last_clean":"2024-05-14T15:15:48.659797+0000","last_became_active":"2024-05-14T15:15:47.486549+0000","last_became_peered":"2024-05-14T15:15:47.486549+0000","last_unstale":"2024-05-14T15:15:48.659797+0000","last_undegraded":"2024-05-14T15:15:48.659797+0000","last_fullsized":"2024-05-14T15:15:48.659797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717975+0000","last_change":"2024-05-14T15:15:43.465531+0000","last_active":"2024-05-14T15:15:49.717975+0000","last_peered":"2024-05-14T15:15:49.717975+0000","last_clean":"2024-05-14T15:15:49.717975+0000","last_became_active":"2024-05-14T15:15:43.464373+0000","last_became_peered":"2024-05-14T15:15:43.464373+0000","last_unstale":"2024-05-14T15:15:49.717975+0000","last_undegraded":"2024-05-14T15:15:49.717975+0000","last_fullsized":"2024-05-14T15:15:49.717975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494929+0000","last_change":"2024-05-14T15:15:42.418453+0000","last_active":"2024-05-14T15:15:48.494929+0000","last_peered":"2024-05-14T15:15:48.494929+0000","last_clean":"2024-05-14T15:15:48.494929+0000","last_became_active":"2024-05-14T15:15:42.418059+0000","last_became_peered":"2024-05-14T15:15:42.418059+0000","last_unstale":"2024-05-14T15:15:48.494929+0000","last_undegraded":"2024-05-14T15:15:48.494929+0000","last_fullsized":"2024-05-14T15:15:48.494929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:32.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661174+0000","last_change":"2024-05-14T15:15:47.481831+0000","last_active":"2024-05-14T15:15:48.661174+0000","last_peered":"2024-05-14T15:15:48.661174+0000","last_clean":"2024-05-14T15:15:48.661174+0000","last_became_active":"2024-05-14T15:15:47.481346+0000","last_became_peered":"2024-05-14T15:15:47.481346+0000","last_unstale":"2024-05-14T15:15:48.661174+0000","last_undegraded":"2024-05-14T15:15:48.661174+0000","last_fullsized":"2024-05-14T15:15:48.661174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:00.730977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495341+0000","last_change":"2024-05-14T15:15:43.467579+0000","last_active":"2024-05-14T15:15:48.495341+0000","last_peered":"2024-05-14T15:15:48.495341+0000","last_clean":"2024-05-14T15:15:48.495341+0000","last_became_active":"2024-05-14T15:15:43.454366+0000","last_became_peered":"2024-05-14T15:15:43.454366+0000","last_unstale":"2024-05-14T15:15:48.495341+0000","last_undegraded":"2024-05-14T15:15:48.495341+0000","last_fullsized":"2024-05-14T15:15:48.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624009+0000","last_change":"2024-05-14T15:15:42.420082+0000","last_active":"2024-05-14T15:15:48.624009+0000","last_peered":"2024-05-14T15:15:48.624009+0000","last_clean":"2024-05-14T15:15:48.624009+0000","last_became_active":"2024-05-14T15:15:42.418989+0000","last_became_peered":"2024-05-14T15:15:42.418989+0000","last_unstale":"2024-05-14T15:15:48.624009+0000","last_undegraded":"2024-05-14T15:15:48.624009+0000","last_fullsized":"2024-05-14T15:15:48.624009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660851+0000","last_change":"2024-05-14T15:15:47.486116+0000","last_active":"2024-05-14T15:15:48.660851+0000","last_peered":"2024-05-14T15:15:48.660851+0000","last_clean":"2024-05-14T15:15:48.660851+0000","last_became_active":"2024-05-14T15:15:47.485631+0000","last_became_peered":"2024-05-14T15:15:47.485631+0000","last_unstale":"2024-05-14T15:15:48.660851+0000","last_undegraded":"2024-05-14T15:15:48.660851+0000","last_fullsized":"2024-05-14T15:15:48.660851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:18.678917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659639+0000","last_change":"2024-05-14T15:15:43.457783+0000","last_active":"2024-05-14T15:15:48.659639+0000","last_peered":"2024-05-14T15:15:48.659639+0000","last_clean":"2024-05-14T15:15:48.659639+0000","last_became_active":"2024-05-14T15:15:43.457467+0000","last_became_peered":"2024-05-14T15:15:43.457467+0000","last_unstale":"2024-05-14T15:15:48.659639+0000","last_undegraded":"2024-05-14T15:15:48.659639+0000","last_fullsized":"2024-05-14T15:15:48.659639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:46.016672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493577+0000","last_change":"2024-05-14T15:15:42.420702+0000","last_active":"2024-05-14T15:15:48.493577+0000","last_peered":"2024-05-14T15:15:48.493577+0000","last_clean":"2024-05-14T15:15:48.493577+0000","last_became_active":"2024-05-14T15:15:42.420368+0000","last_became_peered":"2024-05-14T15:15:42.420368+0000","last_unstale":"2024-05-14T15:15:48.493577+0000","last_undegraded":"2024-05-14T15:15:48.493577+0000","last_fullsized":"2024-05-14T15:15:48.493577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:19.912181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497528+0000","last_change":"2024-05-14T15:15:47.494317+0000","last_active":"2024-05-14T15:15:48.497528+0000","last_peered":"2024-05-14T15:15:48.497528+0000","last_clean":"2024-05-14T15:15:48.497528+0000","last_became_active":"2024-05-14T15:15:47.493154+0000","last_became_peered":"2024-05-14T15:15:47.493154+0000","last_unstale":"2024-05-14T15:15:48.497528+0000","last_undegraded":"2024-05-14T15:15:48.497528+0000","last_fullsized":"2024-05-14T15:15:48.497528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:41.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498904+0000","last_change":"2024-05-14T15:15:43.443926+0000","last_active":"2024-05-14T15:15:48.498904+0000","last_peered":"2024-05-14T15:15:48.498904+0000","last_clean":"2024-05-14T15:15:48.498904+0000","last_became_active":"2024-05-14T15:15:43.443583+0000","last_became_peered":"2024-05-14T15:15:43.443583+0000","last_unstale":"2024-05-14T15:15:48.498904+0000","last_undegraded":"2024-05-14T15:15:48.498904+0000","last_fullsized":"2024-05-14T15:15:48.498904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:30.263461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494582+0000","last_change":"2024-05-14T15:15:42.425277+0000","last_active":"2024-05-14T15:15:48.494582+0000","last_peered":"2024-05-14T15:15:48.494582+0000","last_clean":"2024-05-14T15:15:48.494582+0000","last_became_active":"2024-05-14T15:15:42.424947+0000","last_became_peered":"2024-05-14T15:15:42.424947+0000","last_unstale":"2024-05-14T15:15:48.494582+0000","last_undegraded":"2024-05-14T15:15:48.494582+0000","last_fullsized":"2024-05-14T15:15:48.494582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716310+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:15:49.716310+0000","last_peered":"2024-05-14T15:15:49.716310+0000","last_clean":"2024-05-14T15:15:49.716310+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:15:49.716310+0000","last_undegraded":"2024-05-14T15:15:49.716310+0000","last_fullsized":"2024-05-14T15:15:49.716310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495545+0000","last_change":"2024-05-14T15:15:47.472173+0000","last_active":"2024-05-14T15:15:48.495545+0000","last_peered":"2024-05-14T15:15:48.495545+0000","last_clean":"2024-05-14T15:15:48.495545+0000","last_became_active":"2024-05-14T15:15:47.471697+0000","last_became_peered":"2024-05-14T15:15:47.471697+0000","last_unstale":"2024-05-14T15:15:48.495545+0000","last_undegraded":"2024-05-14T15:15:48.495545+0000","last_fullsized":"2024-05-14T15:15:48.495545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:52:45.119238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495230+0000","last_change":"2024-05-14T15:15:43.448608+0000","last_active":"2024-05-14T15:15:48.495230+0000","last_peered":"2024-05-14T15:15:48.495230+0000","last_clean":"2024-05-14T15:15:48.495230+0000","last_became_active":"2024-05-14T15:15:43.448235+0000","last_became_peered":"2024-05-14T15:15:43.448235+0000","last_unstale":"2024-05-14T15:15:48.495230+0000","last_undegraded":"2024-05-14T15:15:48.495230+0000","last_fullsized":"2024-05-14T15:15:48.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:00.533218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661459+0000","last_change":"2024-05-14T15:15:42.428026+0000","last_active":"2024-05-14T15:15:48.661459+0000","last_peered":"2024-05-14T15:15:48.661459+0000","last_clean":"2024-05-14T15:15:48.661459+0000","last_became_active":"2024-05-14T15:15:42.427537+0000","last_became_peered":"2024-05-14T15:15:42.427537+0000","last_unstale":"2024-05-14T15:15:48.661459+0000","last_undegraded":"2024-05-14T15:15:48.661459+0000","last_fullsized":"2024-05-14T15:15:48.661459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717385+0000","last_change":"2024-05-14T15:15:47.490170+0000","last_active":"2024-05-14T15:15:49.717385+0000","last_peered":"2024-05-14T15:15:49.717385+0000","last_clean":"2024-05-14T15:15:49.717385+0000","last_became_active":"2024-05-14T15:15:47.487824+0000","last_became_peered":"2024-05-14T15:15:47.487824+0000","last_unstale":"2024-05-14T15:15:49.717385+0000","last_undegraded":"2024-05-14T15:15:49.717385+0000","last_fullsized":"2024-05-14T15:15:49.717385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:49.464915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720510+0000","last_change":"2024-05-14T15:15:43.464058+0000","last_active":"2024-05-14T15:15:49.720510+0000","last_peered":"2024-05-14T15:15:49.720510+0000","last_clean":"2024-05-14T15:15:49.720510+0000","last_became_active":"2024-05-14T15:15:43.463701+0000","last_became_peered":"2024-05-14T15:15:43.463701+0000","last_unstale":"2024-05-14T15:15:49.720510+0000","last_undegraded":"2024-05-14T15:15:49.720510+0000","last_fullsized":"2024-05-14T15:15:49.720510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498005+0000","last_change":"2024-05-14T15:15:42.411298+0000","last_active":"2024-05-14T15:15:48.498005+0000","last_peered":"2024-05-14T15:15:48.498005+0000","last_clean":"2024-05-14T15:15:48.498005+0000","last_became_active":"2024-05-14T15:15:42.410793+0000","last_became_peered":"2024-05-14T15:15:42.410793+0000","last_unstale":"2024-05-14T15:15:48.498005+0000","last_undegraded":"2024-05-14T15:15:48.498005+0000","last_fullsized":"2024-05-14T15:15:48.498005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497076+0000","last_change":"2024-05-14T15:15:47.467300+0000","last_active":"2024-05-14T15:15:48.497076+0000","last_peered":"2024-05-14T15:15:48.497076+0000","last_clean":"2024-05-14T15:15:48.497076+0000","last_became_active":"2024-05-14T15:15:47.466741+0000","last_became_peered":"2024-05-14T15:15:47.466741+0000","last_unstale":"2024-05-14T15:15:48.497076+0000","last_undegraded":"2024-05-14T15:15:48.497076+0000","last_fullsized":"2024-05-14T15:15:48.497076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:53.743066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720754+0000","last_change":"2024-05-14T15:15:43.447908+0000","last_active":"2024-05-14T15:15:49.720754+0000","last_peered":"2024-05-14T15:15:49.720754+0000","last_clean":"2024-05-14T15:15:49.720754+0000","last_became_active":"2024-05-14T15:15:43.447571+0000","last_became_peered":"2024-05-14T15:15:43.447571+0000","last_unstale":"2024-05-14T15:15:49.720754+0000","last_undegraded":"2024-05-14T15:15:49.720754+0000","last_fullsized":"2024-05-14T15:15:49.720754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501459+0000","last_change":"2024-05-14T15:15:42.417527+0000","last_active":"2024-05-14T15:15:48.501459+0000","last_peered":"2024-05-14T15:15:48.501459+0000","last_clean":"2024-05-14T15:15:48.501459+0000","last_became_active":"2024-05-14T15:15:42.417147+0000","last_became_peered":"2024-05-14T15:15:42.417147+0000","last_unstale":"2024-05-14T15:15:48.501459+0000","last_undegraded":"2024-05-14T15:15:48.501459+0000","last_fullsized":"2024-05-14T15:15:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:56:23.532241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.492764+0000","last_change":"2024-05-14T15:15:47.474753+0000","last_active":"2024-05-14T15:15:48.492764+0000","last_peered":"2024-05-14T15:15:48.492764+0000","last_clean":"2024-05-14T15:15:48.492764+0000","last_became_active":"2024-05-14T15:15:47.471673+0000","last_became_peered":"2024-05-14T15:15:47.471673+0000","last_unstale":"2024-05-14T15:15:48.492764+0000","last_undegraded":"2024-05-14T15:15:48.492764+0000","last_fullsized":"2024-05-14T15:15:48.492764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:24:43.316754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718819+0000","last_change":"2024-05-14T15:15:43.466649+0000","last_active":"2024-05-14T15:15:49.718819+0000","last_peered":"2024-05-14T15:15:49.718819+0000","last_clean":"2024-05-14T15:15:49.718819+0000","last_became_active":"2024-05-14T15:15:43.466206+0000","last_became_peered":"2024-05-14T15:15:43.466206+0000","last_unstale":"2024-05-14T15:15:49.718819+0000","last_undegraded":"2024-05-14T15:15:49.718819+0000","last_fullsized":"2024-05-14T15:15:49.718819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720923+0000","last_change":"2024-05-14T15:15:42.423219+0000","last_active":"2024-05-14T15:15:49.720923+0000","last_peered":"2024-05-14T15:15:49.720923+0000","last_clean":"2024-05-14T15:15:49.720923+0000","last_became_active":"2024-05-14T15:15:42.419631+0000","last_became_peered":"2024-05-14T15:15:42.419631+0000","last_unstale":"2024-05-14T15:15:49.720923+0000","last_undegraded":"2024-05-14T15:15:49.720923+0000","last_fullsized":"2024-05-14T15:15:49.720923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715423+0000","last_change":"2024-05-14T15:15:47.467637+0000","last_active":"2024-05-14T15:15:49.715423+0000","last_peered":"2024-05-14T15:15:49.715423+0000","last_clean":"2024-05-14T15:15:49.715423+0000","last_became_active":"2024-05-14T15:15:47.467193+0000","last_became_peered":"2024-05-14T15:15:47.467193+0000","last_unstale":"2024-05-14T15:15:49.715423+0000","last_undegraded":"2024-05-14T15:15:49.715423+0000","last_fullsized":"2024-05-14T15:15:49.715423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:26.200001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493066+0000","last_change":"2024-05-14T15:15:43.452875+0000","last_active":"2024-05-14T15:15:48.493066+0000","last_peered":"2024-05-14T15:15:48.493066+0000","last_clean":"2024-05-14T15:15:48.493066+0000","last_became_active":"2024-05-14T15:15:43.451854+0000","last_became_peered":"2024-05-14T15:15:43.451854+0000","last_unstale":"2024-05-14T15:15:48.493066+0000","last_undegraded":"2024-05-14T15:15:48.493066+0000","last_fullsized":"2024-05-14T15:15:48.493066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:42.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496486+0000","last_change":"2024-05-14T15:15:42.415604+0000","last_active":"2024-05-14T15:15:48.496486+0000","last_peered":"2024-05-14T15:15:48.496486+0000","last_clean":"2024-05-14T15:15:48.496486+0000","last_became_active":"2024-05-14T15:15:42.415191+0000","last_became_peered":"2024-05-14T15:15:42.415191+0000","last_unstale":"2024-05-14T15:15:48.496486+0000","last_undegraded":"2024-05-14T15:15:48.496486+0000","last_fullsized":"2024-05-14T15:15:48.496486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:57:56.475764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498134+0000","last_change":"2024-05-14T15:15:47.479478+0000","last_active":"2024-05-14T15:15:48.498134+0000","last_peered":"2024-05-14T15:15:48.498134+0000","last_clean":"2024-05-14T15:15:48.498134+0000","last_became_active":"2024-05-14T15:15:47.479035+0000","last_became_peered":"2024-05-14T15:15:47.479035+0000","last_unstale":"2024-05-14T15:15:48.498134+0000","last_undegraded":"2024-05-14T15:15:48.498134+0000","last_fullsized":"2024-05-14T15:15:48.498134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:21.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716155+0000","last_change":"2024-05-14T15:15:43.428593+0000","last_active":"2024-05-14T15:15:49.716155+0000","last_peered":"2024-05-14T15:15:49.716155+0000","last_clean":"2024-05-14T15:15:49.716155+0000","last_became_active":"2024-05-14T15:15:43.427534+0000","last_became_peered":"2024-05-14T15:15:43.427534+0000","last_unstale":"2024-05-14T15:15:49.716155+0000","last_undegraded":"2024-05-14T15:15:49.716155+0000","last_fullsized":"2024-05-14T15:15:49.716155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715821+0000","last_change":"2024-05-14T15:15:42.422410+0000","last_active":"2024-05-14T15:15:49.715821+0000","last_peered":"2024-05-14T15:15:49.715821+0000","last_clean":"2024-05-14T15:15:49.715821+0000","last_became_active":"2024-05-14T15:15:42.422082+0000","last_became_peered":"2024-05-14T15:15:42.422082+0000","last_unstale":"2024-05-14T15:15:49.715821+0000","last_undegraded":"2024-05-14T15:15:49.715821+0000","last_fullsized":"2024-05-14T15:15:49.715821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500190+0000","last_change":"2024-05-14T15:15:47.484942+0000","last_active":"2024-05-14T15:15:48.500190+0000","last_peered":"2024-05-14T15:15:48.500190+0000","last_clean":"2024-05-14T15:15:48.500190+0000","last_became_active":"2024-05-14T15:15:47.484470+0000","last_became_peered":"2024-05-14T15:15:47.484470+0000","last_unstale":"2024-05-14T15:15:48.500190+0000","last_undegraded":"2024-05-14T15:15:48.500190+0000","last_fullsized":"2024-05-14T15:15:48.500190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:55:55.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494248+0000","last_change":"2024-05-14T15:15:43.453259+0000","last_active":"2024-05-14T15:15:48.494248+0000","last_peered":"2024-05-14T15:15:48.494248+0000","last_clean":"2024-05-14T15:15:48.494248+0000","last_became_active":"2024-05-14T15:15:43.452961+0000","last_became_peered":"2024-05-14T15:15:43.452961+0000","last_unstale":"2024-05-14T15:15:48.494248+0000","last_undegraded":"2024-05-14T15:15:48.494248+0000","last_fullsized":"2024-05-14T15:15:48.494248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:22.596094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494575+0000","last_change":"2024-05-14T15:15:42.421393+0000","last_active":"2024-05-14T15:15:48.494575+0000","last_peered":"2024-05-14T15:15:48.494575+0000","last_clean":"2024-05-14T15:15:48.494575+0000","last_became_active":"2024-05-14T15:15:42.420606+0000","last_became_peered":"2024-05-14T15:15:42.420606+0000","last_unstale":"2024-05-14T15:15:48.494575+0000","last_undegraded":"2024-05-14T15:15:48.494575+0000","last_fullsized":"2024-05-14T15:15:48.494575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:54.271748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660641+0000","last_change":"2024-05-14T15:15:47.487448+0000","last_active":"2024-05-14T15:15:48.660641+0000","last_peered":"2024-05-14T15:15:48.660641+0000","last_clean":"2024-05-14T15:15:48.660641+0000","last_became_active":"2024-05-14T15:15:47.487018+0000","last_became_peered":"2024-05-14T15:15:47.487018+0000","last_unstale":"2024-05-14T15:15:48.660641+0000","last_undegraded":"2024-05-14T15:15:48.660641+0000","last_fullsized":"2024-05-14T15:15:48.660641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:46.795075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660071+0000","last_change":"2024-05-14T15:15:43.471275+0000","last_active":"2024-05-14T15:15:48.660071+0000","last_peered":"2024-05-14T15:15:48.660071+0000","last_clean":"2024-05-14T15:15:48.660071+0000","last_became_active":"2024-05-14T15:15:43.469496+0000","last_became_peered":"2024-05-14T15:15:43.469496+0000","last_unstale":"2024-05-14T15:15:48.660071+0000","last_undegraded":"2024-05-14T15:15:48.660071+0000","last_fullsized":"2024-05-14T15:15:48.660071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624389+0000","last_change":"2024-05-14T15:15:42.427285+0000","last_active":"2024-05-14T15:15:48.624389+0000","last_peered":"2024-05-14T15:15:48.624389+0000","last_clean":"2024-05-14T15:15:48.624389+0000","last_became_active":"2024-05-14T15:15:42.426859+0000","last_became_peered":"2024-05-14T15:15:42.426859+0000","last_unstale":"2024-05-14T15:15:48.624389+0000","last_undegraded":"2024-05-14T15:15:48.624389+0000","last_fullsized":"2024-05-14T15:15:48.624389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495007+0000","last_change":"2024-05-14T15:15:47.490888+0000","last_active":"2024-05-14T15:15:48.495007+0000","last_peered":"2024-05-14T15:15:48.495007+0000","last_clean":"2024-05-14T15:15:48.495007+0000","last_became_active":"2024-05-14T15:15:47.482649+0000","last_became_peered":"2024-05-14T15:15:47.482649+0000","last_unstale":"2024-05-14T15:15:48.495007+0000","last_undegraded":"2024-05-14T15:15:48.495007+0000","last_fullsized":"2024-05-14T15:15:48.495007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:26.333915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720738+0000","last_change":"2024-05-14T15:15:43.452281+0000","last_active":"2024-05-14T15:15:49.720738+0000","last_peered":"2024-05-14T15:15:49.720738+0000","last_clean":"2024-05-14T15:15:49.720738+0000","last_became_active":"2024-05-14T15:15:43.446861+0000","last_became_peered":"2024-05-14T15:15:43.446861+0000","last_unstale":"2024-05-14T15:15:49.720738+0000","last_undegraded":"2024-05-14T15:15:49.720738+0000","last_fullsized":"2024-05-14T15:15:49.720738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:59.089651+0000","last_change":"2024-05-14T15:15:42.423989+0000","last_active":"2024-05-14T15:15:59.089651+0000","last_peered":"2024-05-14T15:15:59.089651+0000","last_clean":"2024-05-14T15:15:59.089651+0000","last_became_active":"2024-05-14T15:15:42.423577+0000","last_became_peered":"2024-05-14T15:15:42.423577+0000","last_unstale":"2024-05-14T15:15:59.089651+0000","last_undegraded":"2024-05-14T15:15:59.089651+0000","last_fullsized":"2024-05-14T15:15:59.089651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:04.149215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498558+0000","last_change":"2024-05-14T15:15:47.475619+0000","last_active":"2024-05-14T15:15:48.498558+0000","last_peered":"2024-05-14T15:15:48.498558+0000","last_clean":"2024-05-14T15:15:48.498558+0000","last_became_active":"2024-05-14T15:15:47.471644+0000","last_became_peered":"2024-05-14T15:15:47.471644+0000","last_unstale":"2024-05-14T15:15:48.498558+0000","last_undegraded":"2024-05-14T15:15:48.498558+0000","last_fullsized":"2024-05-14T15:15:48.498558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:20:14.327039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494104+0000","last_change":"2024-05-14T15:15:43.452445+0000","last_active":"2024-05-14T15:15:48.494104+0000","last_peered":"2024-05-14T15:15:48.494104+0000","last_clean":"2024-05-14T15:15:48.494104+0000","last_became_active":"2024-05-14T15:15:43.452110+0000","last_became_peered":"2024-05-14T15:15:43.452110+0000","last_unstale":"2024-05-14T15:15:48.494104+0000","last_undegraded":"2024-05-14T15:15:48.494104+0000","last_fullsized":"2024-05-14T15:15:48.494104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:58.112691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624967+0000","last_change":"2024-05-14T15:15:42.414691+0000","last_active":"2024-05-14T15:15:48.624967+0000","last_peered":"2024-05-14T15:15:48.624967+0000","last_clean":"2024-05-14T15:15:48.624967+0000","last_became_active":"2024-05-14T15:15:42.411431+0000","last_became_peered":"2024-05-14T15:15:42.411431+0000","last_unstale":"2024-05-14T15:15:48.624967+0000","last_undegraded":"2024-05-14T15:15:48.624967+0000","last_fullsized":"2024-05-14T15:15:48.624967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718327+0000","last_change":"2024-05-14T15:15:47.490431+0000","last_active":"2024-05-14T15:15:49.718327+0000","last_peered":"2024-05-14T15:15:49.718327+0000","last_clean":"2024-05-14T15:15:49.718327+0000","last_became_active":"2024-05-14T15:15:47.488871+0000","last_became_peered":"2024-05-14T15:15:47.488871+0000","last_unstale":"2024-05-14T15:15:49.718327+0000","last_undegraded":"2024-05-14T15:15:49.718327+0000","last_fullsized":"2024-05-14T15:15:49.718327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:36.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500537+0000","last_change":"2024-05-14T15:15:43.471432+0000","last_active":"2024-05-14T15:15:48.500537+0000","last_peered":"2024-05-14T15:15:48.500537+0000","last_clean":"2024-05-14T15:15:48.500537+0000","last_became_active":"2024-05-14T15:15:43.468506+0000","last_became_peered":"2024-05-14T15:15:43.468506+0000","last_unstale":"2024-05-14T15:15:48.500537+0000","last_undegraded":"2024-05-14T15:15:48.500537+0000","last_fullsized":"2024-05-14T15:15:48.500537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721397+0000","last_change":"2024-05-14T15:15:42.425352+0000","last_active":"2024-05-14T15:15:49.721397+0000","last_peered":"2024-05-14T15:15:49.721397+0000","last_clean":"2024-05-14T15:15:49.721397+0000","last_became_active":"2024-05-14T15:15:42.424788+0000","last_became_peered":"2024-05-14T15:15:42.424788+0000","last_unstale":"2024-05-14T15:15:49.721397+0000","last_undegraded":"2024-05-14T15:15:49.721397+0000","last_fullsized":"2024-05-14T15:15:49.721397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623638+0000","last_change":"2024-05-14T15:15:47.495775+0000","last_active":"2024-05-14T15:15:48.623638+0000","last_peered":"2024-05-14T15:15:48.623638+0000","last_clean":"2024-05-14T15:15:48.623638+0000","last_became_active":"2024-05-14T15:15:47.494949+0000","last_became_peered":"2024-05-14T15:15:47.494949+0000","last_unstale":"2024-05-14T15:15:48.623638+0000","last_undegraded":"2024-05-14T15:15:48.623638+0000","last_fullsized":"2024-05-14T15:15:48.623638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:24.981952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718767+0000","last_change":"2024-05-14T15:15:43.455269+0000","last_active":"2024-05-14T15:15:49.718767+0000","last_peered":"2024-05-14T15:15:49.718767+0000","last_clean":"2024-05-14T15:15:49.718767+0000","last_became_active":"2024-05-14T15:15:43.454902+0000","last_became_peered":"2024-05-14T15:15:43.454902+0000","last_unstale":"2024-05-14T15:15:49.718767+0000","last_undegraded":"2024-05-14T15:15:49.718767+0000","last_fullsized":"2024-05-14T15:15:49.718767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720229+0000","last_change":"2024-05-14T15:15:42.413462+0000","last_active":"2024-05-14T15:15:49.720229+0000","last_peered":"2024-05-14T15:15:49.720229+0000","last_clean":"2024-05-14T15:15:49.720229+0000","last_became_active":"2024-05-14T15:15:42.412838+0000","last_became_peered":"2024-05-14T15:15:42.412838+0000","last_unstale":"2024-05-14T15:15:49.720229+0000","last_undegraded":"2024-05-14T15:15:49.720229+0000","last_fullsized":"2024-05-14T15:15:49.720229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499953+0000","last_change":"2024-05-14T15:15:47.481470+0000","last_active":"2024-05-14T15:15:48.499953+0000","last_peered":"2024-05-14T15:15:48.499953+0000","last_clean":"2024-05-14T15:15:48.499953+0000","last_became_active":"2024-05-14T15:15:47.480935+0000","last_became_peered":"2024-05-14T15:15:47.480935+0000","last_unstale":"2024-05-14T15:15:48.499953+0000","last_undegraded":"2024-05-14T15:15:48.499953+0000","last_fullsized":"2024-05-14T15:15:48.499953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:27.398715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501300+0000","last_change":"2024-05-14T15:15:47.470190+0000","last_active":"2024-05-14T15:15:48.501300+0000","last_peered":"2024-05-14T15:15:48.501300+0000","last_clean":"2024-05-14T15:15:48.501300+0000","last_became_active":"2024-05-14T15:15:47.469486+0000","last_became_peered":"2024-05-14T15:15:47.469486+0000","last_unstale":"2024-05-14T15:15:48.501300+0000","last_undegraded":"2024-05-14T15:15:48.501300+0000","last_fullsized":"2024-05-14T15:15:48.501300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:02:29.447286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500142+0000","last_change":"2024-05-14T15:15:43.432186+0000","last_active":"2024-05-14T15:15:48.500142+0000","last_peered":"2024-05-14T15:15:48.500142+0000","last_clean":"2024-05-14T15:15:48.500142+0000","last_became_active":"2024-05-14T15:15:43.431075+0000","last_became_peered":"2024-05-14T15:15:43.431075+0000","last_unstale":"2024-05-14T15:15:48.500142+0000","last_undegraded":"2024-05-14T15:15:48.500142+0000","last_fullsized":"2024-05-14T15:15:48.500142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:57.608006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493573+0000","last_change":"2024-05-14T15:15:42.429681+0000","last_active":"2024-05-14T15:15:48.493573+0000","last_peered":"2024-05-14T15:15:48.493573+0000","last_clean":"2024-05-14T15:15:48.493573+0000","last_became_active":"2024-05-14T15:15:42.426654+0000","last_became_peered":"2024-05-14T15:15:42.426654+0000","last_unstale":"2024-05-14T15:15:48.493573+0000","last_undegraded":"2024-05-14T15:15:48.493573+0000","last_fullsized":"2024-05-14T15:15:48.493573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:21.130230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496123+0000","last_change":"2024-05-14T15:15:47.474072+0000","last_active":"2024-05-14T15:15:48.496123+0000","last_peered":"2024-05-14T15:15:48.496123+0000","last_clean":"2024-05-14T15:15:48.496123+0000","last_became_active":"2024-05-14T15:15:47.473621+0000","last_became_peered":"2024-05-14T15:15:47.473621+0000","last_unstale":"2024-05-14T15:15:48.496123+0000","last_undegraded":"2024-05-14T15:15:48.496123+0000","last_fullsized":"2024-05-14T15:15:48.496123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:49.410071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495656+0000","last_change":"2024-05-14T15:15:43.448709+0000","last_active":"2024-05-14T15:15:48.495656+0000","last_peered":"2024-05-14T15:15:48.495656+0000","last_clean":"2024-05-14T15:15:48.495656+0000","last_became_active":"2024-05-14T15:15:43.448068+0000","last_became_peered":"2024-05-14T15:15:43.448068+0000","last_unstale":"2024-05-14T15:15:48.495656+0000","last_undegraded":"2024-05-14T15:15:48.495656+0000","last_fullsized":"2024-05-14T15:15:48.495656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659737+0000","last_change":"2024-05-14T15:15:42.429751+0000","last_active":"2024-05-14T15:15:48.659737+0000","last_peered":"2024-05-14T15:15:48.659737+0000","last_clean":"2024-05-14T15:15:48.659737+0000","last_became_active":"2024-05-14T15:15:42.429380+0000","last_became_peered":"2024-05-14T15:15:42.429380+0000","last_unstale":"2024-05-14T15:15:48.659737+0000","last_undegraded":"2024-05-14T15:15:48.659737+0000","last_fullsized":"2024-05-14T15:15:48.659737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494212+0000","last_change":"2024-05-14T15:15:42.428978+0000","last_active":"2024-05-14T15:15:48.494212+0000","last_peered":"2024-05-14T15:15:48.494212+0000","last_clean":"2024-05-14T15:15:48.494212+0000","last_became_active":"2024-05-14T15:15:42.428627+0000","last_became_peered":"2024-05-14T15:15:42.428627+0000","last_unstale":"2024-05-14T15:15:48.494212+0000","last_undegraded":"2024-05-14T15:15:48.494212+0000","last_fullsized":"2024-05-14T15:15:48.494212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:05.667253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499610+0000","last_change":"2024-05-14T15:15:43.447982+0000","last_active":"2024-05-14T15:15:48.499610+0000","last_peered":"2024-05-14T15:15:48.499610+0000","last_clean":"2024-05-14T15:15:48.499610+0000","last_became_active":"2024-05-14T15:15:43.446590+0000","last_became_peered":"2024-05-14T15:15:43.446590+0000","last_unstale":"2024-05-14T15:15:48.499610+0000","last_undegraded":"2024-05-14T15:15:48.499610+0000","last_fullsized":"2024-05-14T15:15:48.499610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:05.808230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499664+0000","last_change":"2024-05-14T15:15:47.488195+0000","last_active":"2024-05-14T15:15:48.499664+0000","last_peered":"2024-05-14T15:15:48.499664+0000","last_clean":"2024-05-14T15:15:48.499664+0000","last_became_active":"2024-05-14T15:15:47.487122+0000","last_became_peered":"2024-05-14T15:15:47.487122+0000","last_unstale":"2024-05-14T15:15:48.499664+0000","last_undegraded":"2024-05-14T15:15:48.499664+0000","last_fullsized":"2024-05-14T15:15:48.499664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:10:11.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499154+0000","last_change":"2024-05-14T15:15:42.420415+0000","last_active":"2024-05-14T15:15:48.499154+0000","last_peered":"2024-05-14T15:15:48.499154+0000","last_clean":"2024-05-14T15:15:48.499154+0000","last_became_active":"2024-05-14T15:15:42.420023+0000","last_became_peered":"2024-05-14T15:15:42.420023+0000","last_unstale":"2024-05-14T15:15:48.499154+0000","last_undegraded":"2024-05-14T15:15:48.499154+0000","last_fullsized":"2024-05-14T15:15:48.499154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717100+0000","last_change":"2024-05-14T15:15:43.442403+0000","last_active":"2024-05-14T15:15:49.717100+0000","last_peered":"2024-05-14T15:15:49.717100+0000","last_clean":"2024-05-14T15:15:49.717100+0000","last_became_active":"2024-05-14T15:15:43.442018+0000","last_became_peered":"2024-05-14T15:15:43.442018+0000","last_unstale":"2024-05-14T15:15:49.717100+0000","last_undegraded":"2024-05-14T15:15:49.717100+0000","last_fullsized":"2024-05-14T15:15:49.717100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624856+0000","last_change":"2024-05-14T15:15:47.484476+0000","last_active":"2024-05-14T15:15:48.624856+0000","last_peered":"2024-05-14T15:15:48.624856+0000","last_clean":"2024-05-14T15:15:48.624856+0000","last_became_active":"2024-05-14T15:15:47.483990+0000","last_became_peered":"2024-05-14T15:15:47.483990+0000","last_unstale":"2024-05-14T15:15:48.624856+0000","last_undegraded":"2024-05-14T15:15:48.624856+0000","last_fullsized":"2024-05-14T15:15:48.624856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:44.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717437+0000","last_change":"2024-05-14T15:15:43.452753+0000","last_active":"2024-05-14T15:15:49.717437+0000","last_peered":"2024-05-14T15:15:49.717437+0000","last_clean":"2024-05-14T15:15:49.717437+0000","last_became_active":"2024-05-14T15:15:43.450752+0000","last_became_peered":"2024-05-14T15:15:43.450752+0000","last_unstale":"2024-05-14T15:15:49.717437+0000","last_undegraded":"2024-05-14T15:15:49.717437+0000","last_fullsized":"2024-05-14T15:15:49.717437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623679+0000","last_change":"2024-05-14T15:15:43.459094+0000","last_active":"2024-05-14T15:15:48.623679+0000","last_peered":"2024-05-14T15:15:48.623679+0000","last_clean":"2024-05-14T15:15:48.623679+0000","last_became_active":"2024-05-14T15:15:43.458723+0000","last_became_peered":"2024-05-14T15:15:43.458723+0000","last_unstale":"2024-05-14T15:15:48.623679+0000","last_undegraded":"2024-05-14T15:15:48.623679+0000","last_fullsized":"2024-05-14T15:15:48.623679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493568+0000","last_change":"2024-05-14T15:15:43.446191+0000","last_active":"2024-05-14T15:15:48.493568+0000","last_peered":"2024-05-14T15:15:48.493568+0000","last_clean":"2024-05-14T15:15:48.493568+0000","last_became_active":"2024-05-14T15:15:43.445883+0000","last_became_peered":"2024-05-14T15:15:43.445883+0000","last_unstale":"2024-05-14T15:15:48.493568+0000","last_undegraded":"2024-05-14T15:15:48.493568+0000","last_fullsized":"2024-05-14T15:15:48.493568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:09.798116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497390+0000","last_change":"2024-05-14T15:15:43.462772+0000","last_active":"2024-05-14T15:15:48.497390+0000","last_peered":"2024-05-14T15:15:48.497390+0000","last_clean":"2024-05-14T15:15:48.497390+0000","last_became_active":"2024-05-14T15:15:43.458133+0000","last_became_peered":"2024-05-14T15:15:43.458133+0000","last_unstale":"2024-05-14T15:15:48.497390+0000","last_undegraded":"2024-05-14T15:15:48.497390+0000","last_fullsized":"2024-05-14T15:15:48.497390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660954+0000","last_change":"2024-05-14T15:15:43.464641+0000","last_active":"2024-05-14T15:15:48.660954+0000","last_peered":"2024-05-14T15:15:48.660954+0000","last_clean":"2024-05-14T15:15:48.660954+0000","last_became_active":"2024-05-14T15:15:43.464263+0000","last_became_peered":"2024-05-14T15:15:43.464263+0000","last_unstale":"2024-05-14T15:15:48.660954+0000","last_undegraded":"2024-05-14T15:15:48.660954+0000","last_fullsized":"2024-05-14T15:15:48.660954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660941+0000","last_change":"2024-05-14T15:15:43.453266+0000","last_active":"2024-05-14T15:15:48.660941+0000","last_peered":"2024-05-14T15:15:48.660941+0000","last_clean":"2024-05-14T15:15:48.660941+0000","last_became_active":"2024-05-14T15:15:43.452641+0000","last_became_peered":"2024-05-14T15:15:43.452641+0000","last_unstale":"2024-05-14T15:15:48.660941+0000","last_undegraded":"2024-05-14T15:15:48.660941+0000","last_fullsized":"2024-05-14T15:15:48.660941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:22.144652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718639+0000","last_change":"2024-05-14T15:15:43.455928+0000","last_active":"2024-05-14T15:15:49.718639+0000","last_peered":"2024-05-14T15:15:49.718639+0000","last_clean":"2024-05-14T15:15:49.718639+0000","last_became_active":"2024-05-14T15:15:43.454949+0000","last_became_peered":"2024-05-14T15:15:43.454949+0000","last_unstale":"2024-05-14T15:15:49.718639+0000","last_undegraded":"2024-05-14T15:15:49.718639+0000","last_fullsized":"2024-05-14T15:15:49.718639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499982+0000","last_change":"2024-05-14T15:15:43.470552+0000","last_active":"2024-05-14T15:15:48.499982+0000","last_peered":"2024-05-14T15:15:48.499982+0000","last_clean":"2024-05-14T15:15:48.499982+0000","last_became_active":"2024-05-14T15:15:43.453144+0000","last_became_peered":"2024-05-14T15:15:43.453144+0000","last_unstale":"2024-05-14T15:15:48.499982+0000","last_undegraded":"2024-05-14T15:15:48.499982+0000","last_fullsized":"2024-05-14T15:15:48.499982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493251+0000","last_change":"2024-05-14T15:15:43.442622+0000","last_active":"2024-05-14T15:15:48.493251+0000","last_peered":"2024-05-14T15:15:48.493251+0000","last_clean":"2024-05-14T15:15:48.493251+0000","last_became_active":"2024-05-14T15:15:43.442296+0000","last_became_peered":"2024-05-14T15:15:43.442296+0000","last_unstale":"2024-05-14T15:15:48.493251+0000","last_undegraded":"2024-05-14T15:15:48.493251+0000","last_fullsized":"2024-05-14T15:15:48.493251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496080+0000","last_change":"2024-05-14T15:15:43.447439+0000","last_active":"2024-05-14T15:15:48.496080+0000","last_peered":"2024-05-14T15:15:48.496080+0000","last_clean":"2024-05-14T15:15:48.496080+0000","last_became_active":"2024-05-14T15:15:43.446137+0000","last_became_peered":"2024-05-14T15:15:43.446137+0000","last_unstale":"2024-05-14T15:15:48.496080+0000","last_undegraded":"2024-05-14T15:15:48.496080+0000","last_fullsized":"2024-05-14T15:15:48.496080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716730+0000","last_change":"2024-05-14T15:15:43.449082+0000","last_active":"2024-05-14T15:15:49.716730+0000","last_peered":"2024-05-14T15:15:49.716730+0000","last_clean":"2024-05-14T15:15:49.716730+0000","last_became_active":"2024-05-14T15:15:43.446819+0000","last_became_peered":"2024-05-14T15:15:43.446819+0000","last_unstale":"2024-05-14T15:15:49.716730+0000","last_undegraded":"2024-05-14T15:15:49.716730+0000","last_fullsized":"2024-05-14T15:15:49.716730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499241+0000","last_change":"2024-05-14T15:15:43.447350+0000","last_active":"2024-05-14T15:15:48.499241+0000","last_peered":"2024-05-14T15:15:48.499241+0000","last_clean":"2024-05-14T15:15:48.499241+0000","last_became_active":"2024-05-14T15:15:43.445520+0000","last_became_peered":"2024-05-14T15:15:43.445520+0000","last_unstale":"2024-05-14T15:15:48.499241+0000","last_undegraded":"2024-05-14T15:15:48.499241+0000","last_fullsized":"2024-05-14T15:15:48.499241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:59:26.779034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720137+0000","last_change":"2024-05-14T15:15:43.455780+0000","last_active":"2024-05-14T15:15:49.720137+0000","last_peered":"2024-05-14T15:15:49.720137+0000","last_clean":"2024-05-14T15:15:49.720137+0000","last_became_active":"2024-05-14T15:15:43.450530+0000","last_became_peered":"2024-05-14T15:15:43.450530+0000","last_unstale":"2024-05-14T15:15:49.720137+0000","last_undegraded":"2024-05-14T15:15:49.720137+0000","last_fullsized":"2024-05-14T15:15:49.720137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495537+0000","last_change":"2024-05-14T15:15:43.444694+0000","last_active":"2024-05-14T15:15:48.495537+0000","last_peered":"2024-05-14T15:15:48.495537+0000","last_clean":"2024-05-14T15:15:48.495537+0000","last_became_active":"2024-05-14T15:15:43.444051+0000","last_became_peered":"2024-05-14T15:15:43.444051+0000","last_unstale":"2024-05-14T15:15:48.495537+0000","last_undegraded":"2024-05-14T15:15:48.495537+0000","last_fullsized":"2024-05-14T15:15:48.495537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:37.310772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625143+0000","last_change":"2024-05-14T15:15:43.460795+0000","last_active":"2024-05-14T15:15:48.625143+0000","last_peered":"2024-05-14T15:15:48.625143+0000","last_clean":"2024-05-14T15:15:48.625143+0000","last_became_active":"2024-05-14T15:15:43.460482+0000","last_became_peered":"2024-05-14T15:15:43.460482+0000","last_unstale":"2024-05-14T15:15:48.625143+0000","last_undegraded":"2024-05-14T15:15:48.625143+0000","last_fullsized":"2024-05-14T15:15:48.625143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496414+0000","last_change":"2024-05-14T15:15:43.454445+0000","last_active":"2024-05-14T15:15:48.496414+0000","last_peered":"2024-05-14T15:15:48.496414+0000","last_clean":"2024-05-14T15:15:48.496414+0000","last_became_active":"2024-05-14T15:15:43.453963+0000","last_became_peered":"2024-05-14T15:15:43.453963+0000","last_unstale":"2024-05-14T15:15:48.496414+0000","last_undegraded":"2024-05-14T15:15:48.496414+0000","last_fullsized":"2024-05-14T15:15:48.496414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:17.114782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493224+0000","last_change":"2024-05-14T15:15:43.451680+0000","last_active":"2024-05-14T15:15:48.493224+0000","last_peered":"2024-05-14T15:15:48.493224+0000","last_clean":"2024-05-14T15:15:48.493224+0000","last_became_active":"2024-05-14T15:15:43.451213+0000","last_became_peered":"2024-05-14T15:15:43.451213+0000","last_unstale":"2024-05-14T15:15:48.493224+0000","last_undegraded":"2024-05-14T15:15:48.493224+0000","last_fullsized":"2024-05-14T15:15:48.493224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495636+0000","last_change":"2024-05-14T15:15:43.450048+0000","last_active":"2024-05-14T15:15:48.495636+0000","last_peered":"2024-05-14T15:15:48.495636+0000","last_clean":"2024-05-14T15:15:48.495636+0000","last_became_active":"2024-05-14T15:15:43.447077+0000","last_became_peered":"2024-05-14T15:15:43.447077+0000","last_unstale":"2024-05-14T15:15:48.495636+0000","last_undegraded":"2024-05-14T15:15:48.495636+0000","last_fullsized":"2024-05-14T15:15:48.495636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:44.172442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659777+0000","last_change":"2024-05-14T15:15:43.452199+0000","last_active":"2024-05-14T15:15:48.659777+0000","last_peered":"2024-05-14T15:15:48.659777+0000","last_clean":"2024-05-14T15:15:48.659777+0000","last_became_active":"2024-05-14T15:15:43.451112+0000","last_became_peered":"2024-05-14T15:15:43.451112+0000","last_unstale":"2024-05-14T15:15:48.659777+0000","last_undegraded":"2024-05-14T15:15:48.659777+0000","last_fullsized":"2024-05-14T15:15:48.659777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660603+0000","last_change":"2024-05-14T15:15:43.467060+0000","last_active":"2024-05-14T15:15:48.660603+0000","last_peered":"2024-05-14T15:15:48.660603+0000","last_clean":"2024-05-14T15:15:48.660603+0000","last_became_active":"2024-05-14T15:15:43.466622+0000","last_became_peered":"2024-05-14T15:15:43.466622+0000","last_unstale":"2024-05-14T15:15:48.660603+0000","last_undegraded":"2024-05-14T15:15:48.660603+0000","last_fullsized":"2024-05-14T15:15:48.660603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:40.234140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.719694+0000","last_change":"2024-05-14T15:15:43.457250+0000","last_active":"2024-05-14T15:15:49.719694+0000","last_peered":"2024-05-14T15:15:49.719694+0000","last_clean":"2024-05-14T15:15:49.719694+0000","last_became_active":"2024-05-14T15:15:43.456942+0000","last_became_peered":"2024-05-14T15:15:43.456942+0000","last_unstale":"2024-05-14T15:15:49.719694+0000","last_undegraded":"2024-05-14T15:15:49.719694+0000","last_fullsized":"2024-05-14T15:15:49.719694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720574+0000","last_change":"2024-05-14T15:15:43.457388+0000","last_active":"2024-05-14T15:15:49.720574+0000","last_peered":"2024-05-14T15:15:49.720574+0000","last_clean":"2024-05-14T15:15:49.720574+0000","last_became_active":"2024-05-14T15:15:43.457024+0000","last_became_peered":"2024-05-14T15:15:43.457024+0000","last_unstale":"2024-05-14T15:15:49.720574+0000","last_undegraded":"2024-05-14T15:15:49.720574+0000","last_fullsized":"2024-05-14T15:15:49.720574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721313+0000","last_change":"2024-05-14T15:15:43.455894+0000","last_active":"2024-05-14T15:15:49.721313+0000","last_peered":"2024-05-14T15:15:49.721313+0000","last_clean":"2024-05-14T15:15:49.721313+0000","last_became_active":"2024-05-14T15:15:43.455558+0000","last_became_peered":"2024-05-14T15:15:43.455558+0000","last_unstale":"2024-05-14T15:15:49.721313+0000","last_undegraded":"2024-05-14T15:15:49.721313+0000","last_fullsized":"2024-05-14T15:15:49.721313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720231+0000","last_change":"2024-05-14T15:15:43.466235+0000","last_active":"2024-05-14T15:15:49.720231+0000","last_peered":"2024-05-14T15:15:49.720231+0000","last_clean":"2024-05-14T15:15:49.720231+0000","last_became_active":"2024-05-14T15:15:43.465681+0000","last_became_peered":"2024-05-14T15:15:43.465681+0000","last_unstale":"2024-05-14T15:15:49.720231+0000","last_undegraded":"2024-05-14T15:15:49.720231+0000","last_fullsized":"2024-05-14T15:15:49.720231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496181+0000","last_change":"2024-05-14T15:15:43.450897+0000","last_active":"2024-05-14T15:15:48.496181+0000","last_peered":"2024-05-14T15:15:48.496181+0000","last_clean":"2024-05-14T15:15:48.496181+0000","last_became_active":"2024-05-14T15:15:43.450206+0000","last_became_peered":"2024-05-14T15:15:43.450206+0000","last_unstale":"2024-05-14T15:15:48.496181+0000","last_undegraded":"2024-05-14T15:15:48.496181+0000","last_fullsized":"2024-05-14T15:15:48.496181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715857+0000","last_change":"2024-05-14T15:15:43.456409+0000","last_active":"2024-05-14T15:15:49.715857+0000","last_peered":"2024-05-14T15:15:49.715857+0000","last_clean":"2024-05-14T15:15:49.715857+0000","last_became_active":"2024-05-14T15:15:43.448064+0000","last_became_peered":"2024-05-14T15:15:43.448064+0000","last_unstale":"2024-05-14T15:15:49.715857+0000","last_undegraded":"2024-05-14T15:15:49.715857+0000","last_fullsized":"2024-05-14T15:15:49.715857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717628+0000","last_change":"2024-05-14T15:15:43.448505+0000","last_active":"2024-05-14T15:15:49.717628+0000","last_peered":"2024-05-14T15:15:49.717628+0000","last_clean":"2024-05-14T15:15:49.717628+0000","last_became_active":"2024-05-14T15:15:43.448130+0000","last_became_peered":"2024-05-14T15:15:43.448130+0000","last_unstale":"2024-05-14T15:15:49.717628+0000","last_undegraded":"2024-05-14T15:15:49.717628+0000","last_fullsized":"2024-05-14T15:15:49.717628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717789+0000","last_change":"2024-05-14T15:15:43.441410+0000","last_active":"2024-05-14T15:15:49.717789+0000","last_peered":"2024-05-14T15:15:49.717789+0000","last_clean":"2024-05-14T15:15:49.717789+0000","last_became_active":"2024-05-14T15:15:43.440720+0000","last_became_peered":"2024-05-14T15:15:43.440720+0000","last_unstale":"2024-05-14T15:15:49.717789+0000","last_undegraded":"2024-05-14T15:15:49.717789+0000","last_fullsized":"2024-05-14T15:15:49.717789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717624+0000","last_change":"2024-05-14T15:15:43.449956+0000","last_active":"2024-05-14T15:15:49.717624+0000","last_peered":"2024-05-14T15:15:49.717624+0000","last_clean":"2024-05-14T15:15:49.717624+0000","last_became_active":"2024-05-14T15:15:43.449153+0000","last_became_peered":"2024-05-14T15:15:43.449153+0000","last_unstale":"2024-05-14T15:15:49.717624+0000","last_undegraded":"2024-05-14T15:15:49.717624+0000","last_fullsized":"2024-05-14T15:15:49.717624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497578+0000","last_change":"2024-05-14T15:15:43.431817+0000","last_active":"2024-05-14T15:15:48.497578+0000","last_peered":"2024-05-14T15:15:48.497578+0000","last_clean":"2024-05-14T15:15:48.497578+0000","last_became_active":"2024-05-14T15:15:43.431329+0000","last_became_peered":"2024-05-14T15:15:43.431329+0000","last_unstale":"2024-05-14T15:15:48.497578+0000","last_undegraded":"2024-05-14T15:15:48.497578+0000","last_fullsized":"2024-05-14T15:15:48.497578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497862+0000","last_change":"2024-05-14T15:15:43.453311+0000","last_active":"2024-05-14T15:15:48.497862+0000","last_peered":"2024-05-14T15:15:48.497862+0000","last_clean":"2024-05-14T15:15:48.497862+0000","last_became_active":"2024-05-14T15:15:43.449852+0000","last_became_peered":"2024-05-14T15:15:43.449852+0000","last_unstale":"2024-05-14T15:15:48.497862+0000","last_undegraded":"2024-05-14T15:15:48.497862+0000","last_fullsized":"2024-05-14T15:15:48.497862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720694+0000","last_change":"2024-05-14T15:15:43.468567+0000","last_active":"2024-05-14T15:15:49.720694+0000","last_peered":"2024-05-14T15:15:49.720694+0000","last_clean":"2024-05-14T15:15:49.720694+0000","last_became_active":"2024-05-14T15:15:43.468239+0000","last_became_peered":"2024-05-14T15:15:43.468239+0000","last_unstale":"2024-05-14T15:15:49.720694+0000","last_undegraded":"2024-05-14T15:15:49.720694+0000","last_fullsized":"2024-05-14T15:15:49.720694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":109456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":110128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:16:10.946 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T15:16:10.946 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T15:16:10.947 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-14T15:16:10.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-14T15:16:10.947 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-14T15:16:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.274+0000 7fe4d3000640 1 Processor -- start 2024-05-14T15:16:11.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.274+0000 7fe4d3000640 1 -- start start 2024-05-14T15:16:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d3000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4cc0d0e80 0x7fe4cc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d3000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc163bb0 0x7fe4cc06d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d3000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc0d48d0 con 0x7fe4cc0b4dc0 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d3000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe4cc0d4bb0 con 0x7fe4cc0d0e80 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d3000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d4e90 con 0x7fe4cc163bb0 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d1200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4cc0d0e80 0x7fe4cc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d1c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe4cc0b4dc0 0x7fe4cc0d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36744/0 (socket says 172.21.15.2:36744) 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d1c00640 1 -- 172.21.15.2:0/752575065 learned_addr learned my addr 172.21.15.2:0/752575065 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.276+0000 7fe4d2600640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc163bb0 0x7fe4cc06d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.277+0000 7fe4d1200640 1 -- 172.21.15.2:0/752575065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc163bb0 msgr2=0x7fe4cc06d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.277+0000 7fe4d1200640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc163bb0 0x7fe4cc06d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.277+0000 7fe4d1200640 1 -- 172.21.15.2:0/752575065 >> v1:172.21.15.2:6789/0 conn(0x7fe4cc0b4dc0 legacy=0x7fe4cc0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.277+0000 7fe4d1200640 1 -- 172.21.15.2:0/752575065 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc0d5170 con 0x7fe4cc0d0e80 2024-05-14T15:16:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.277+0000 7fe4d2600640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc163bb0 0x7fe4cc06d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.277+0000 7fe4cbe00640 1 -- 172.21.15.2:0/752575065 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536990360 0 0) 0x7fe4cc0d48d0 con 0x7fe4cc0b4dc0 2024-05-14T15:16:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.278+0000 7fe4d1200640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc0d0e80 0x7fe4cc06cb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224359b05e5da351 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.278+0000 7fe4cbe00640 1 -- 172.21.15.2:0/752575065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc037070 con 0x7fe4cc0d0e80 2024-05-14T15:16:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.278+0000 7fe4cbe00640 1 -- 172.21.15.2:0/752575065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc032440 con 0x7fe4cc0d0e80 2024-05-14T15:16:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.278+0000 7fe4cbe00640 1 -- 172.21.15.2:0/752575065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc032810 con 0x7fe4cc0d0e80 2024-05-14T15:16:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 -- 172.21.15.2:0/752575065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc0d0e80 msgr2=0x7fe4cc06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc0d0e80 0x7fe4cc06cb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02a180 comp rx=0 tx=0).stop 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 -- 172.21.15.2:0/752575065 shutdown_connections 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc163bb0 0x7fe4cc06d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 --2- 172.21.15.2:0/752575065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc0d0e80 0x7fe4cc06cb40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 -- 172.21.15.2:0/752575065 >> 172.21.15.2:0/752575065 conn(0x7fe4cc0b7600 msgr2=0x7fe4cc0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 -- 172.21.15.2:0/752575065 shutdown_connections 2024-05-14T15:16:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.279+0000 7fe4d3000640 1 -- 172.21.15.2:0/752575065 wait complete. 2024-05-14T15:16:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.282+0000 7fe4d3000640 1 Processor -- start 2024-05-14T15:16:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.282+0000 7fe4d3000640 1 -- start start 2024-05-14T15:16:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.283+0000 7fe4d3000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc0b4dc0 0x7fe4cc15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.283+0000 7fe4d3000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc163bb0 0x7fe4cc1f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.283+0000 7fe4d3000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 0x7fe4cc0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.283+0000 7fe4d3000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d4490 con 0x7fe4cc154d30 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.283+0000 7fe4d3000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d4310 con 0x7fe4cc163bb0 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.283+0000 7fe4d3000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d4610 con 0x7fe4cc0b4dc0 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 0x7fe4cc0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 0x7fe4cc0cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58580/0 (socket says 172.21.15.2:58580) 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 -- 172.21.15.2:0/4196317127 learned_addr learned my addr 172.21.15.2:0/4196317127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d1200640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc163bb0 0x7fe4cc1f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d1c00640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc0b4dc0 0x7fe4cc15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 -- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc0b4dc0 msgr2=0x7fe4cc15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc0b4dc0 0x7fe4cc15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 -- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc163bb0 msgr2=0x7fe4cc1f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc163bb0 0x7fe4cc1f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.284+0000 7fe4d2600640 1 -- 172.21.15.2:0/4196317127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc15f080 con 0x7fe4cc154d30 2024-05-14T15:16:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.285+0000 7fe4d2600640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 0x7fe4cc0cd820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4007e60 tx=0x7fe4c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.285+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c401a070 con 0x7fe4cc154d30 2024-05-14T15:16:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.285+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c4015600 con 0x7fe4cc154d30 2024-05-14T15:16:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.285+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40159f0 con 0x7fe4cc154d30 2024-05-14T15:16:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.285+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc0cc780 con 0x7fe4cc154d30 2024-05-14T15:16:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.285+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc0ccd40 con 0x7fe4cc154d30 2024-05-14T15:16:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.287+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc050870 con 0x7fe4cc154d30 2024-05-14T15:16:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.288+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe4c401d070 con 0x7fe4cc154d30 2024-05-14T15:16:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.290+0000 7fe4c9600640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4b00762d0 0x7fe4b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.290+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe4c4097c60 con 0x7fe4cc154d30 2024-05-14T15:16:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.290+0000 7fe4d1c00640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4b00762d0 0x7fe4b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.291+0000 7fe4d1c00640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4b00762d0 0x7fe4b00787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000f60 tx=0x7fe4c0007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.294+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe4c4010070 con 0x7fe4cc154d30 2024-05-14T15:16:11.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.572+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe4cc06d760 con 0x7fe4cc154d30 2024-05-14T15:16:11.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.581+0000 7fe4c9600640 1 -- 172.21.15.2:0/4196317127 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189524 (secure 0 0 0) 0x7fe4c40611e0 con 0x7fe4cc154d30 2024-05-14T15:16:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4b00762d0 msgr2=0x7fe4b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4b00762d0 0x7fe4b00787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000f60 tx=0x7fe4c0007c00 comp rx=0 tx=0).stop 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 msgr2=0x7fe4cc0cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 0x7fe4cc0cd820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4007e60 tx=0x7fe4c400d4a0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 shutdown_connections 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4b00762d0 0x7fe4b00787e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc163bb0 0x7fe4cc1f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4cc154d30 0x7fe4cc0cd820 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 --2- 172.21.15.2:0/4196317127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc0b4dc0 0x7fe4cc15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 >> 172.21.15.2:0/4196317127 conn(0x7fe4cc0b7600 msgr2=0x7fe4cc0bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:11.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.586+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 shutdown_connections 2024-05-14T15:16:11.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.587+0000 7fe4d3000640 1 -- 172.21.15.2:0/4196317127 wait complete. 2024-05-14T15:16:11.611 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3501490630},{"type":"v1","addr":"172.21.15.156:6833","nonce":3501490630}]},"active_addr":"172.21.15.156:6833/3501490630","active_change":"2024-05-14T15:15:28.812863+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3196963198}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":12122871}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1409533723}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":61610221}]}]} 2024-05-14T15:16:11.615 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-14T15:16:11.615 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-14T15:16:11.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:11.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.899+0000 7f1c5ae00640 1 Processor -- start 2024-05-14T15:16:11.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.899+0000 7f1c5ae00640 1 -- start start 2024-05-14T15:16:11.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c5ae00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c540706e0 0x7f1c54160070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c5ae00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c540b4690 0x7f1c54164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c5ae00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c54164860 0x7f1c5406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c5ae00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1c540b4e00 con 0x7f1c54164860 2024-05-14T15:16:11.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c5ae00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f1c540b50e0 con 0x7f1c540706e0 2024-05-14T15:16:11.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c5ae00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1c540b53c0 con 0x7f1c540b4690 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c53e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c540706e0 0x7f1c54160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c54164860 0x7f1c5406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c53400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c540b4690 0x7f1c54164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c54164860 0x7f1c5406d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58584/0 (socket says 172.21.15.2:58584) 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 -- 172.21.15.2:0/1311049414 learned_addr learned my addr 172.21.15.2:0/1311049414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 -- 172.21.15.2:0/1311049414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c540b4690 msgr2=0x7f1c54164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 --2- 172.21.15.2:0/1311049414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c540b4690 0x7f1c54164320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 -- 172.21.15.2:0/1311049414 >> v2:172.21.15.156:3300/0 conn(0x7f1c540706e0 msgr2=0x7f1c54160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.902+0000 7f1c58e00640 1 --2- 172.21.15.2:0/1311049414 >> v2:172.21.15.156:3300/0 conn(0x7f1c540706e0 0x7f1c54160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.903+0000 7f1c58e00640 1 -- 172.21.15.2:0/1311049414 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c54163e00 con 0x7f1c54164860 2024-05-14T15:16:11.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.904+0000 7f1c58e00640 1 --2- 172.21.15.2:0/1311049414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c54164860 0x7f1c5406d700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c54073470 tx=0x7f1c4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6928472c0211cad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.904+0000 7f1c52a00640 1 -- 172.21.15.2:0/1311049414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c036070 con 0x7f1c54164860 2024-05-14T15:16:11.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.904+0000 7f1c52a00640 1 -- 172.21.15.2:0/1311049414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c031600 con 0x7f1c54164860 2024-05-14T15:16:11.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.904+0000 7f1c52a00640 1 -- 172.21.15.2:0/1311049414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0319d0 con 0x7f1c54164860 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 -- 172.21.15.2:0/1311049414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c54164860 msgr2=0x7f1c5406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/1311049414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c54164860 0x7f1c5406d700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c54073470 tx=0x7f1c4c02a6a0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 -- 172.21.15.2:0/1311049414 shutdown_connections 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/1311049414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c54164860 0x7f1c5406d700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/1311049414 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c540b4690 0x7f1c54164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/1311049414 >> v2:172.21.15.156:3300/0 conn(0x7f1c540706e0 0x7f1c54160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 -- 172.21.15.2:0/1311049414 >> 172.21.15.2:0/1311049414 conn(0x7f1c540d1d10 msgr2=0x7f1c540734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 -- 172.21.15.2:0/1311049414 shutdown_connections 2024-05-14T15:16:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.906+0000 7f1c5ae00640 1 -- 172.21.15.2:0/1311049414 wait complete. 2024-05-14T15:16:11.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.908+0000 7f1c5ae00640 1 Processor -- start 2024-05-14T15:16:11.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.908+0000 7f1c5ae00640 1 -- start start 2024-05-14T15:16:11.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.909+0000 7f1c5ae00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c540706e0 0x7f1c54152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.909+0000 7f1c5ae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 0x7f1c54160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.909+0000 7f1c5ae00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c54164860 0x7f1c541f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.909+0000 7f1c5ae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5406ddc0 con 0x7f1c540b4690 2024-05-14T15:16:11.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.909+0000 7f1c5ae00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5406dc40 con 0x7f1c540706e0 2024-05-14T15:16:11.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.909+0000 7f1c5ae00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5406df40 con 0x7f1c54164860 2024-05-14T15:16:11.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 0x7f1c54160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 0x7f1c54160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58594/0 (socket says 172.21.15.2:58594) 2024-05-14T15:16:11.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 -- 172.21.15.2:0/3322551757 learned_addr learned my addr 172.21.15.2:0/3322551757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:11.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53e00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c540706e0 0x7f1c54152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c58e00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c54164860 0x7f1c541f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 -- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c54164860 msgr2=0x7f1c541f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c54164860 0x7f1c541f76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 -- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c540706e0 msgr2=0x7f1c54152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c540706e0 0x7f1c54152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.910+0000 7f1c53400640 1 -- 172.21.15.2:0/3322551757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c54158000 con 0x7f1c540b4690 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.911+0000 7f1c53400640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 0x7f1c54160e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000e870 tx=0x7f1c4000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.911+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40017070 con 0x7f1c540b4690 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.911+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4000c940 con 0x7f1c540b4690 2024-05-14T15:16:11.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.911+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000cd10 con 0x7f1c540b4690 2024-05-14T15:16:11.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.911+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c54160070 con 0x7f1c540b4690 2024-05-14T15:16:11.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.911+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c54160630 con 0x7f1c540b4690 2024-05-14T15:16:11.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.912+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5406d700 con 0x7f1c540b4690 2024-05-14T15:16:11.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.915+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c4001a070 con 0x7f1c540b4690 2024-05-14T15:16:11.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.915+0000 7f1c4be00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1c340762d0 0x7f1c340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.916+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1c40097b90 con 0x7f1c540b4690 2024-05-14T15:16:11.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.916+0000 7f1c53e00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1c340762d0 0x7f1c340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.917+0000 7f1c53e00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1c340762d0 0x7f1c340787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009a30 tx=0x7f1c44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:11.922+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c5406d700 con 0x7f1c540b4690 2024-05-14T15:16:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.132+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c5415d4f0 con 0x7f1c540b4690 2024-05-14T15:16:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.134+0000 7f1c4be00640 1 -- 172.21.15.2:0/3322551757 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7f1c5415d4f0 con 0x7f1c540b4690 2024-05-14T15:16:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:12.134 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.136+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1c340762d0 msgr2=0x7f1c340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.136+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1c340762d0 0x7f1c340787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009a30 tx=0x7f1c44008040 comp rx=0 tx=0).stop 2024-05-14T15:16:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.136+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 msgr2=0x7f1c54160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.136+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 0x7f1c54160e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000e870 tx=0x7f1c4000ed30 comp rx=0 tx=0).stop 2024-05-14T15:16:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 shutdown_connections 2024-05-14T15:16:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1c340762d0 0x7f1c340787e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c54164860 0x7f1c541f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c540b4690 0x7f1c54160e30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 --2- 172.21.15.2:0/3322551757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c540706e0 0x7f1c54152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 >> 172.21.15.2:0/3322551757 conn(0x7f1c540d1d10 msgr2=0x7f1c540af290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 shutdown_connections 2024-05-14T15:16:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.137+0000 7f1c5ae00640 1 -- 172.21.15.2:0/3322551757 wait complete. 2024-05-14T15:16:12.163 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-14T15:16:12.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:12.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.445+0000 7f1497e00640 1 Processor -- start 2024-05-14T15:16:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.445+0000 7f1497e00640 1 -- start start 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1497e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149806fbd0 0x7f1498163af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1497e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1498164030 0x7f149806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1497e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806dc40 0x7f14980af130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1497e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f149806f180 con 0x7f149806fbd0 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1497e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f149806e050 con 0x7f1498164030 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1497e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1498164590 con 0x7f149806dc40 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.448+0000 7f1496a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149806fbd0 0x7f1498163af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f148e000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1498164030 0x7f149806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1497400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806dc40 0x7f14980af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149806fbd0 0x7f1498163af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58598/0 (socket says 172.21.15.2:58598) 2024-05-14T15:16:12.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 -- 172.21.15.2:0/2404163302 learned_addr learned my addr 172.21.15.2:0/2404163302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:12.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 -- 172.21.15.2:0/2404163302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806dc40 msgr2=0x7f14980af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:12.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 --2- 172.21.15.2:0/2404163302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806dc40 0x7f14980af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 -- 172.21.15.2:0/2404163302 >> v2:172.21.15.156:3300/0 conn(0x7f1498164030 msgr2=0x7f149806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:12.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 --2- 172.21.15.2:0/2404163302 >> v2:172.21.15.156:3300/0 conn(0x7f1498164030 0x7f149806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.449+0000 7f1496a00640 1 -- 172.21.15.2:0/2404163302 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1498164870 con 0x7f149806fbd0 2024-05-14T15:16:12.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.451+0000 7f1496a00640 1 --2- 172.21.15.2:0/2404163302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149806fbd0 0x7f1498163af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1498069610 tx=0x7f148802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f61c168383ad3f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:12.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.452+0000 7f1496000640 1 -- 172.21.15.2:0/2404163302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488036070 con 0x7f149806fbd0 2024-05-14T15:16:12.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.452+0000 7f1496000640 1 -- 172.21.15.2:0/2404163302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1488031600 con 0x7f149806fbd0 2024-05-14T15:16:12.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.452+0000 7f1496000640 1 -- 172.21.15.2:0/2404163302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880319d0 con 0x7f149806fbd0 2024-05-14T15:16:12.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 -- 172.21.15.2:0/2404163302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149806fbd0 msgr2=0x7f1498163af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 --2- 172.21.15.2:0/2404163302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149806fbd0 0x7f1498163af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1498069610 tx=0x7f148802a610 comp rx=0 tx=0).stop 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 -- 172.21.15.2:0/2404163302 shutdown_connections 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 --2- 172.21.15.2:0/2404163302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806dc40 0x7f14980af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 --2- 172.21.15.2:0/2404163302 >> v2:172.21.15.156:3300/0 conn(0x7f1498164030 0x7f149806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 --2- 172.21.15.2:0/2404163302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149806fbd0 0x7f1498163af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 -- 172.21.15.2:0/2404163302 >> 172.21.15.2:0/2404163302 conn(0x7f14980732e0 msgr2=0x7f14980736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.453+0000 7f1497e00640 1 -- 172.21.15.2:0/2404163302 shutdown_connections 2024-05-14T15:16:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.454+0000 7f1497e00640 1 -- 172.21.15.2:0/2404163302 wait complete. 2024-05-14T15:16:12.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.457+0000 7f1497e00640 1 Processor -- start 2024-05-14T15:16:12.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.457+0000 7f1497e00640 1 -- start start 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149806dc40 0x7f149815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806fbd0 0x7f14981f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 0x7f14981fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1498070f20 con 0x7f1498164030 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f149806f6b0 con 0x7f149806dc40 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f14981601a0 con 0x7f149806fbd0 2024-05-14T15:16:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 0x7f14981fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 0x7f14981fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58606/0 (socket says 172.21.15.2:58606) 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1497400640 1 -- 172.21.15.2:0/1849266356 learned_addr learned my addr 172.21.15.2:0/1849266356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.459+0000 7f1496a00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149806dc40 0x7f149815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f148e000640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806fbd0 0x7f14981f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497400640 1 -- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806fbd0 msgr2=0x7f14981f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497400640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806fbd0 0x7f14981f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497400640 1 -- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149806dc40 msgr2=0x7f149815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497400640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149806dc40 0x7f149815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497400640 1 -- 172.21.15.2:0/1849266356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14981566e0 con 0x7f1498164030 2024-05-14T15:16:12.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497400640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 0x7f14981fa2d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f149000e7f0 tx=0x7f149000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:12.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490017070 con 0x7f1498164030 2024-05-14T15:16:12.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149000c6d0 con 0x7f1498164030 2024-05-14T15:16:12.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.460+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1498162140 con 0x7f1498164030 2024-05-14T15:16:12.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.461+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149000cae0 con 0x7f1498164030 2024-05-14T15:16:12.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.461+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1498162700 con 0x7f1498164030 2024-05-14T15:16:12.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.462+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1498161f70 con 0x7f1498164030 2024-05-14T15:16:12.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.463+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f149001a070 con 0x7f1498164030 2024-05-14T15:16:12.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.465+0000 7f148f400640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14740762d0 0x7f14740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:12.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.465+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1490097ae0 con 0x7f1498164030 2024-05-14T15:16:12.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.465+0000 7f1496a00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14740762d0 0x7f14740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:12.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.466+0000 7f1496a00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14740762d0 0x7f14740787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1488033000 tx=0x7f1488009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:12.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.469+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1490061060 con 0x7f1498164030 2024-05-14T15:16:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.682+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1498050870 con 0x7f1498164030 2024-05-14T15:16:12.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.685+0000 7f148f400640 1 -- 172.21.15.2:0/1849266356 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7f1490060960 con 0x7f1498164030 2024-05-14T15:16:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:12.684 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:12.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.687+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14740762d0 msgr2=0x7f14740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.687+0000 7f1497e00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14740762d0 0x7f14740787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1488033000 tx=0x7f1488009000 comp rx=0 tx=0).stop 2024-05-14T15:16:12.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.687+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 msgr2=0x7f14981fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:12.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.687+0000 7f1497e00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 0x7f14981fa2d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f149000e7f0 tx=0x7f149000ecb0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 shutdown_connections 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14740762d0 0x7f14740787e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1498164030 0x7f14981fa2d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f149806fbd0 0x7f14981f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 --2- 172.21.15.2:0/1849266356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149806dc40 0x7f149815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 >> 172.21.15.2:0/1849266356 conn(0x7f14980732e0 msgr2=0x7f14980b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 shutdown_connections 2024-05-14T15:16:12.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:12.688+0000 7f1497e00640 1 -- 172.21.15.2:0/1849266356 wait complete. 2024-05-14T15:16:12.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-14T15:16:12.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-14T15:16:12.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-14T15:16:12.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-14T15:16:12.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-14T15:16:12.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-14T15:16:12.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-14T15:16:12.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-14T15:16:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.132+0000 7f7be5000640 1 Processor -- start 2024-05-14T15:16:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.132+0000 7f7be5000640 1 -- start start 2024-05-14T15:16:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.135+0000 7f7be5000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be0160b40 0x7f7be015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.135+0000 7f7df9000640 1 Processor -- start 2024-05-14T15:16:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7be5000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7be015d0c0 0x7f7be006f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7be5000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be006fbb0 con 0x7f7be006f7a0 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7fea7b400640 1 Processor -- start 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7fea7b400640 1 -- start start 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7be5000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7be0074040 con 0x7f7be015d0c0 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7be5000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7be01606b0 con 0x7f7be0160b40 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7bde800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7be006f7a0 0x7f7be0073930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36752/0 (socket says 172.21.15.2:36752) 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7bde800640 1 -- 172.21.15.2:0/3886140522 learned_addr learned my addr 172.21.15.2:0/3886140522 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.136+0000 7f7bdde00640 1 --2- 172.21.15.2:0/3886140522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be0160b40 0x7f7be015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.137+0000 7f7df9000640 1 -- start start 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.137+0000 7f7bdd400640 1 --2- 172.21.15.2:0/3886140522 >> v2:172.21.15.2:3300/0 conn(0x7f7be015d0c0 0x7f7be006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.137+0000 7f7bdde00640 1 -- 172.21.15.2:0/3886140522 >> v2:172.21.15.2:3300/0 conn(0x7f7be015d0c0 msgr2=0x7f7be006f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.138+0000 7f7bdca00640 1 -- 172.21.15.2:0/3886140522 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190284288 0 0) 0x7f7bd0001110 con 0x7f7be006f7a0 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.138+0000 7f7bdde00640 1 --2- 172.21.15.2:0/3886140522 >> v2:172.21.15.2:3300/0 conn(0x7f7be015d0c0 0x7f7be006f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.138+0000 7f7bdde00640 1 -- 172.21.15.2:0/3886140522 >> v1:172.21.15.2:6789/0 conn(0x7f7be006f7a0 legacy=0x7f7be0073930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.138+0000 7f7bdde00640 1 -- 172.21.15.2:0/3886140522 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be015d690 con 0x7f7be0160b40 2024-05-14T15:16:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.139+0000 7f7bdd400640 1 --2- 172.21.15.2:0/3886140522 >> v2:172.21.15.2:3300/0 conn(0x7f7be015d0c0 0x7f7be006f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7bdde00640 1 --2- 172.21.15.2:0/3886140522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be0160b40 0x7f7be015cb80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009d90 tx=0x7f7bd8032de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=888899455decb2f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7df9000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7df40d08a0 0x7f7df4167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7df9000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7df40d0cb0 0x7f7df4168500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7df9000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7df9000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7df40d4250 con 0x7f7df40d08a0 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7df9000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f7df4168e40 con 0x7f7df40d0cb0 2024-05-14T15:16:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7f7df9000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7df40d56e0 con 0x7f7df406c6f0 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7fea7b400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fea74164720 0x7fea74168200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7fea7b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea74168740 0x7fea7406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7fea7b400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea74164b30 con 0x7fea740ae7c0 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7fea7b400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fea74168b50 con 0x7fea74168740 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.140+0000 7fea7b400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fea740d1210 con 0x7fea74164720 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7f7bdca00640 1 -- 172.21.15.2:0/3886140522 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8040070 con 0x7f7be0160b40 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7f7bdca00640 1 -- 172.21.15.2:0/3886140522 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd8033b30 con 0x7f7be0160b40 2024-05-14T15:16:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7f7bdca00640 1 -- 172.21.15.2:0/3886140522 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd803b440 con 0x7f7be0160b40 2024-05-14T15:16:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7fea79400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea74168740 0x7fea7406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7f7df3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7df40d08a0 0x7f7df4167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7f7df3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7df40d08a0 0x7f7df4167fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58618/0 (socket says 172.21.15.2:58618) 2024-05-14T15:16:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7f7df3400640 1 -- 172.21.15.2:0/65700380 learned_addr learned my addr 172.21.15.2:0/65700380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7fea79400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea74168740 0x7fea7406d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58614/0 (socket says 172.21.15.2:58614) 2024-05-14T15:16:13.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.141+0000 7fea79400640 1 -- 172.21.15.2:0/4116844675 learned_addr learned my addr 172.21.15.2:0/4116844675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7f7df3400640 1 -- 172.21.15.2:0/65700380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 msgr2=0x7f7df406cb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:16:13.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7f7df3400640 1 --2- 172.21.15.2:0/65700380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df406cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7f7df3400640 1 -- 172.21.15.2:0/65700380 >> v2:172.21.15.156:3300/0 conn(0x7f7df40d0cb0 msgr2=0x7f7df4168500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:16:13.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7f7df3400640 1 --2- 172.21.15.2:0/65700380 >> v2:172.21.15.156:3300/0 conn(0x7f7df40d0cb0 0x7f7df4168500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7f7df3400640 1 -- 172.21.15.2:0/65700380 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df40d03e0 con 0x7f7df40d08a0 2024-05-14T15:16:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7fea79400640 1 -- 172.21.15.2:0/4116844675 >> v2:172.21.15.156:3300/0 conn(0x7fea74164720 msgr2=0x7fea74168200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:16:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7fea79400640 1 --2- 172.21.15.2:0/4116844675 >> v2:172.21.15.156:3300/0 conn(0x7fea74164720 0x7fea74168200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7fea79400640 1 -- 172.21.15.2:0/4116844675 >> v1:172.21.15.156:6789/0 conn(0x7fea740ae7c0 legacy=0x7fea7406f8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:16:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.142+0000 7fea79400640 1 -- 172.21.15.2:0/4116844675 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea740d14f0 con 0x7fea74168740 2024-05-14T15:16:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.144+0000 7f7df3400640 1 --2- 172.21.15.2:0/65700380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df40d08a0 0x7f7df4167fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7df40d34c0 tx=0x7f7de002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b049a7bca9bb94 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.144+0000 7fea79400640 1 --2- 172.21.15.2:0/4116844675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea7406d270 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea74073190 tx=0x7fea6002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639f239b3b3a4a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7be5000640 1 -- 172.21.15.2:0/3886140522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be0160b40 msgr2=0x7f7be015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7df2000640 1 -- 172.21.15.2:0/65700380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0037070 con 0x7f7df40d08a0 2024-05-14T15:16:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7fea73400640 1 -- 172.21.15.2:0/4116844675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60037070 con 0x7fea74168740 2024-05-14T15:16:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7df2000640 1 -- 172.21.15.2:0/65700380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de0032440 con 0x7f7df40d08a0 2024-05-14T15:16:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7be5000640 1 --2- 172.21.15.2:0/3886140522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be0160b40 0x7f7be015cb80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009d90 tx=0x7f7bd8032de0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7be5000640 1 -- 172.21.15.2:0/3886140522 shutdown_connections 2024-05-14T15:16:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7df2000640 1 -- 172.21.15.2:0/65700380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0032810 con 0x7f7df40d08a0 2024-05-14T15:16:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7be5000640 1 --2- 172.21.15.2:0/3886140522 >> v2:172.21.15.2:3300/0 conn(0x7f7be015d0c0 0x7f7be006f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7be5000640 1 --2- 172.21.15.2:0/3886140522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be0160b40 0x7f7be015cb80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7f7be5000640 1 -- 172.21.15.2:0/3886140522 >> 172.21.15.2:0/3886140522 conn(0x7f7be00d1910 msgr2=0x7f7be00d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7fea73400640 1 -- 172.21.15.2:0/4116844675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea60032440 con 0x7fea74168740 2024-05-14T15:16:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.145+0000 7fea73400640 1 -- 172.21.15.2:0/4116844675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60037070 con 0x7fea74168740 2024-05-14T15:16:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7be5000640 1 -- 172.21.15.2:0/3886140522 shutdown_connections 2024-05-14T15:16:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 -- 172.21.15.2:0/65700380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df40d08a0 msgr2=0x7f7df4167fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 --2- 172.21.15.2:0/65700380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df40d08a0 0x7f7df4167fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7df40d34c0 tx=0x7f7de002a210 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7fea7b400640 1 -- 172.21.15.2:0/4116844675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 msgr2=0x7fea7406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7fea7b400640 1 --2- 172.21.15.2:0/4116844675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea7406d270 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea74073190 tx=0x7fea6002a200 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7fea7b400640 1 -- 172.21.15.2:0/4116844675 shutdown_connections 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7fea7b400640 1 --2- 172.21.15.2:0/4116844675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea7406d270 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7fea7b400640 1 --2- 172.21.15.2:0/4116844675 >> v2:172.21.15.156:3300/0 conn(0x7fea74164720 0x7fea74168200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7fea7b400640 1 -- 172.21.15.2:0/4116844675 >> 172.21.15.2:0/4116844675 conn(0x7fea740ce230 msgr2=0x7fea740ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 -- 172.21.15.2:0/65700380 shutdown_connections 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 --2- 172.21.15.2:0/65700380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 --2- 172.21.15.2:0/65700380 >> v2:172.21.15.156:3300/0 conn(0x7f7df40d0cb0 0x7f7df4168500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 --2- 172.21.15.2:0/65700380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df40d08a0 0x7f7df4167fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.146+0000 7f7df9000640 1 -- 172.21.15.2:0/65700380 >> 172.21.15.2:0/65700380 conn(0x7f7df40d6050 msgr2=0x7f7df40d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7f7df9000640 1 -- 172.21.15.2:0/65700380 shutdown_connections 2024-05-14T15:16:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7f7be5000640 1 -- 172.21.15.2:0/3886140522 wait complete. 2024-05-14T15:16:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7f7df9000640 1 -- 172.21.15.2:0/65700380 wait complete. 2024-05-14T15:16:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7fea7b400640 1 -- 172.21.15.2:0/4116844675 shutdown_connections 2024-05-14T15:16:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.147+0000 7fea7b400640 1 -- 172.21.15.2:0/4116844675 wait complete. 2024-05-14T15:16:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.150+0000 7f7be5000640 1 Processor -- start 2024-05-14T15:16:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.151+0000 7f7be5000640 1 -- start start 2024-05-14T15:16:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.151+0000 7f7df9000640 1 Processor -- start 2024-05-14T15:16:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.151+0000 7f7df9000640 1 -- start start 2024-05-14T15:16:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.152+0000 7fea7b400640 1 Processor -- start 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7f7df9000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df42060b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7f7df9000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7df40d08a0 0x7f7df42068d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7f7df9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4206e10 0x7f7df40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7f7df9000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7df40cff90 con 0x7f7df4206e10 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7f7df9000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7df40d4780 con 0x7f7df40d08a0 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7f7df9000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7df40d0110 con 0x7f7df406c6f0 2024-05-14T15:16:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.153+0000 7fea7b400640 1 -- start start 2024-05-14T15:16:13.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7be5000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be006f7a0 0x7f7be00afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7be5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7be015d0c0 0x7f7be014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f6b4d000640 1 Processor -- start 2024-05-14T15:16:13.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7be5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be0160b40 0x7f7be0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7df3400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df42060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7df3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4206e10 0x7f7df40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7df3400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df42060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33406/0 (socket says 172.21.15.2:33406) 2024-05-14T15:16:13.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7df3400640 1 -- 172.21.15.2:0/568233164 learned_addr learned my addr 172.21.15.2:0/568233164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f7df2a00640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7df40d08a0 0x7f7df42068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7be5000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7be00b1070 con 0x7f7be0160b40 2024-05-14T15:16:13.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7bde800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be0160b40 0x7f7be0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7bde800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be0160b40 0x7f7be0159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58636/0 (socket says 172.21.15.2:58636) 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7bde800640 1 -- 172.21.15.2:0/3671711638 learned_addr learned my addr 172.21.15.2:0/3671711638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7bdde00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be006f7a0 0x7f7be00afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7bdd400640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7be015d0c0 0x7f7be014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0160340 con 0x7f7be015d0c0 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.155+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7be00b11f0 con 0x7f7be006f7a0 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7f7df3400640 1 -- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7df40d08a0 msgr2=0x7f7df42068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7f7df3400640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7df40d08a0 0x7f7df42068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7f7df3400640 1 -- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4206e10 msgr2=0x7f7df40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7f7df3400640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4206e10 0x7f7df40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7fea7b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740ae7c0 0x7fea74166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7f7df3400640 1 -- 172.21.15.2:0/568233164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df4207220 con 0x7f7df406c6f0 2024-05-14T15:16:13.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7fea7b400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea74164720 0x7fea7414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7df3400640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df42060b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009960 tx=0x7f7de00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7bde800640 1 -- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be006f7a0 msgr2=0x7f7be00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7bde800640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7be006f7a0 0x7f7be00afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7bde800640 1 -- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7be015d0c0 msgr2=0x7f7be014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7bde800640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7be015d0c0 0x7f7be014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7bde800640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be01f2260 con 0x7f7be0160b40 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7fea7b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea740b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7fea7b400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea7406cd50 con 0x7fea74168740 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7fea7b400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fea7406ca70 con 0x7fea740ae7c0 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.156+0000 7fea7b400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fea74168fc0 con 0x7fea74164720 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.154+0000 7f6b4d000640 1 -- start start 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7fea79400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea740b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7fea79400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea740b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58650/0 (socket says 172.21.15.2:58650) 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7fea79400640 1 -- 172.21.15.2:0/3846238996 learned_addr learned my addr 172.21.15.2:0/3846238996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7fea78a00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740ae7c0 0x7fea74166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.157+0000 7f7bde800640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be0160b40 0x7f7be0159f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000c3c0 tx=0x7f7bd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f9c6ae00640 1 Processor -- start 2024-05-14T15:16:13.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0041070 con 0x7f7df406c6f0 2024-05-14T15:16:13.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea79400640 1 -- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea74164720 msgr2=0x7fea7414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea73e00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea74164720 0x7fea7414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de003c870 con 0x7f7df406c6f0 2024-05-14T15:16:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0037040 con 0x7f7df406c6f0 2024-05-14T15:16:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea79400640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea74164720 0x7fea7414fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea79400640 1 -- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740ae7c0 msgr2=0x7fea74166e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea79400640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740ae7c0 0x7fea74166e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea79400640 1 -- 172.21.15.2:0/3846238996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea74167460 con 0x7fea74168740 2024-05-14T15:16:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00074e0 con 0x7f7be0160b40 2024-05-14T15:16:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd00047e0 con 0x7f7be0160b40 2024-05-14T15:16:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0004bd0 con 0x7f7be0160b40 2024-05-14T15:16:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea78a00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740ae7c0 0x7fea74166e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df40ca530 con 0x7f7df406c6f0 2024-05-14T15:16:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b4d000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48164720 0x7f6b48168200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b4d000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b48168740 0x7f6b4806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be00b0430 con 0x7f7be0160b40 2024-05-14T15:16:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be009b890 con 0x7f7be0160b40 2024-05-14T15:16:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7fea73e00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea74164720 0x7fea7414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b4d000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b48164b30 con 0x7f6b480ae7c0 2024-05-14T15:16:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b4d000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f6b48168b50 con 0x7f6b48168740 2024-05-14T15:16:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b4d000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6b480d1210 con 0x7f6b48164720 2024-05-14T15:16:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df40caaf0 con 0x7f7df406c6f0 2024-05-14T15:16:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b45e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6b480ae7c0 0x7f6b4806f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36758/0 (socket says 172.21.15.2:36758) 2024-05-14T15:16:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6192c00640 1 Processor -- start 2024-05-14T15:16:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.159+0000 7f6b45e00640 1 -- 172.21.15.2:0/3000996287 learned_addr learned my addr 172.21.15.2:0/3000996287 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.158+0000 7f9c6ae00640 1 -- start start 2024-05-14T15:16:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f915e800640 1 Processor -- start 2024-05-14T15:16:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7df4050870 con 0x7f7df406c6f0 2024-05-14T15:16:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7be0050870 con 0x7f7be0160b40 2024-05-14T15:16:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f6b45400640 1 --2- 172.21.15.2:0/3000996287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48164720 0x7f6b48168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f6b46800640 1 --2- 172.21.15.2:0/3000996287 >> v2:172.21.15.156:3300/0 conn(0x7f6b48168740 0x7f6b4806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f915e800640 1 -- start start 2024-05-14T15:16:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7fea79400640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea740b1cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea600090b0 tx=0x7fea600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60041020 con 0x7fea74168740 2024-05-14T15:16:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f9c6ae00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c640ae7c0 0x7f9c64164720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f9c6ae00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c64168910 0x7f9c6406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f6b44a00640 1 -- 172.21.15.2:0/3000996287 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11677518 0 0) 0x7f6b48164b30 con 0x7f6b480ae7c0 2024-05-14T15:16:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f6b44a00640 1 -- 172.21.15.2:0/3000996287 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b2c003520 con 0x7f6b480ae7c0 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f9c6ae00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c640d1210 con 0x7f9c6406f8e0 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f9c6ae00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9c640d14f0 con 0x7f9c64168910 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f9c6ae00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6406c790 con 0x7f9c640ae7c0 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7fea7b400640 1 -- 172.21.15.2:0/3846238996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea74164da0 con 0x7fea74168740 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7fea7b400640 1 -- 172.21.15.2:0/3846238996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea74165040 con 0x7fea74168740 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f6b45400640 1 -- 172.21.15.2:0/3000996287 >> v2:172.21.15.156:3300/0 conn(0x7f6b48168740 msgr2=0x7f6b4806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.161+0000 7f6b45400640 1 --2- 172.21.15.2:0/3000996287 >> v2:172.21.15.156:3300/0 conn(0x7f6b48168740 0x7f6b4806d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.162+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea600325f0 con 0x7fea74168740 2024-05-14T15:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.162+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60037040 con 0x7fea74168740 2024-05-14T15:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.162+0000 7f9c68e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c64168910 0x7f9c6406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.162+0000 7f9c63e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c640ae7c0 0x7f9c64164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.162+0000 7f9c63e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c640ae7c0 0x7f9c64164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44722/0 (socket says 172.21.15.2:44722) 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.162+0000 7f9c63e00640 1 -- 172.21.15.2:0/477765131 learned_addr learned my addr 172.21.15.2:0/477765131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6b45400640 1 -- 172.21.15.2:0/3000996287 >> v1:172.21.15.2:6789/0 conn(0x7f6b480ae7c0 legacy=0x7f6b4806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6b45400640 1 -- 172.21.15.2:0/3000996287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b480d14f0 con 0x7f6b48164720 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f9c63e00640 1 -- 172.21.15.2:0/477765131 >> v2:172.21.15.2:3300/0 conn(0x7f9c64168910 msgr2=0x7f9c6406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f9c63e00640 1 --2- 172.21.15.2:0/477765131 >> v2:172.21.15.2:3300/0 conn(0x7f9c64168910 0x7f9c6406d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f9c63e00640 1 -- 172.21.15.2:0/477765131 >> v1:172.21.15.2:6789/0 conn(0x7f9c6406f8e0 legacy=0x7f9c64168200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f9c63e00640 1 -- 172.21.15.2:0/477765131 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6406ca70 con 0x7f9c640ae7c0 2024-05-14T15:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea741659e0 con 0x7fea74168740 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f915e800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 0x7f91500060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f915e800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91500e4b50 con 0x7f915004fa50 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f915e800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91500e4e30 con 0x7f9150037b40 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f915e800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f91500501a0 con 0x7f915003a650 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f915de00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 0x7f91500060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f915de00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 0x7f91500060e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33474/0 (socket says 172.21.15.2:33474) 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f915de00640 1 -- 172.21.15.2:0/401796907 learned_addr learned my addr 172.21.15.2:0/401796907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7de0044070 con 0x7f7df406c6f0 2024-05-14T15:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f9c63e00640 1 --2- 172.21.15.2:0/477765131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c640ae7c0 0x7f9c64164720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c64071910 tx=0x7f9c5402a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ff071332587455 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7f915de00640 1 -- 172.21.15.2:0/401796907 >> v1:172.21.15.156:6789/0 conn(0x7f9150037b40 legacy=0x7f915004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7fa22be00640 1 Processor -- start 2024-05-14T15:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7fa22be00640 1 -- start start 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.160+0000 7f6192c00640 1 -- start start 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6192c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f618c15dd00 0x7f618c0d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6192c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06c6f0 0x7f618c06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6192c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c15e110 con 0x7f618c06d590 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6192c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f618c160a10 con 0x7f618c15dd00 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.163+0000 7f6192c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0d4c40 con 0x7f618c06c6f0 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f6190c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06c6f0 0x7f618c06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f618be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f618c15dd00 0x7f618c0d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f618be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f618c15dd00 0x7f618c0d50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58666/0 (socket says 172.21.15.2:58666) 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.164+0000 7f618be00640 1 -- 172.21.15.2:0/3733188850 learned_addr learned my addr 172.21.15.2:0/3733188850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f618be00640 1 -- 172.21.15.2:0/3733188850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06c6f0 msgr2=0x7f618c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f618be00640 1 --2- 172.21.15.2:0/3733188850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06c6f0 0x7f618c06cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.165+0000 7f618be00640 1 -- 172.21.15.2:0/3733188850 >> v1:172.21.15.2:6789/0 conn(0x7f618c06d590 legacy=0x7f618c06d9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7f618be00640 1 -- 172.21.15.2:0/3733188850 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0d5610 con 0x7f618c15dd00 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7f915de00640 1 -- 172.21.15.2:0/401796907 >> v1:172.21.15.2:6789/0 conn(0x7f915004fa50 legacy=0x7f91500e05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7f915de00640 1 -- 172.21.15.2:0/401796907 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9150050db0 con 0x7f915003a650 2024-05-14T15:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7f9c63400640 1 -- 172.21.15.2:0/477765131 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54037070 con 0x7f9c640ae7c0 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f6b45400640 1 --2- 172.21.15.2:0/3000996287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48164720 0x7f6b48168200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097a0 tx=0x7f6b3402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9142157bce1b0a63 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.166+0000 7f9c63400640 1 -- 172.21.15.2:0/477765131 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c54032440 con 0x7f9c640ae7c0 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 -- 172.21.15.2:0/477765131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c640ae7c0 msgr2=0x7f9c64164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 --2- 172.21.15.2:0/477765131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c640ae7c0 0x7f9c64164720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c64071910 tx=0x7f9c5402a200 comp rx=0 tx=0).stop 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 -- 172.21.15.2:0/477765131 shutdown_connections 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 --2- 172.21.15.2:0/477765131 >> v2:172.21.15.2:3300/0 conn(0x7f9c64168910 0x7f9c6406d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 --2- 172.21.15.2:0/477765131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c640ae7c0 0x7f9c64164720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 -- 172.21.15.2:0/477765131 >> 172.21.15.2:0/477765131 conn(0x7f9c640ce230 msgr2=0x7f9c640ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f9c6ae00640 1 -- 172.21.15.2:0/477765131 shutdown_connections 2024-05-14T15:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f9c6ae00640 1 -- 172.21.15.2:0/477765131 wait complete. 2024-05-14T15:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f618be00640 1 --2- 172.21.15.2:0/3733188850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c15dd00 0x7f618c0d50d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f618c0d3d80 tx=0x7f617402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562fb524d37daab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea60044020 con 0x7fea74168740 2024-05-14T15:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f6b44a00640 1 -- 172.21.15.2:0/3000996287 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34037070 con 0x7f6b48164720 2024-05-14T15:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f6b44a00640 1 -- 172.21.15.2:0/3000996287 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b34032440 con 0x7f6b48164720 2024-05-14T15:16:13.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f6b44a00640 1 -- 172.21.15.2:0/3000996287 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34032850 con 0x7f6b48164720 2024-05-14T15:16:13.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f618aa00640 1 -- 172.21.15.2:0/3733188850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037070 con 0x7f618c15dd00 2024-05-14T15:16:13.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.167+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7bd0011070 con 0x7f7be0160b40 2024-05-14T15:16:13.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f618aa00640 1 -- 172.21.15.2:0/3733188850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6174032440 con 0x7f618c15dd00 2024-05-14T15:16:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f618aa00640 1 -- 172.21.15.2:0/3733188850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174032810 con 0x7f618c15dd00 2024-05-14T15:16:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.168+0000 7f7deb400640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dd40763a0 0x7f7dd40788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fea70c00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fea54076300 0x7fea54078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fea600b8360 con 0x7fea74168740 2024-05-14T15:16:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fa22be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2240d4190 0x7fa2240d5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f6b4d000640 1 -- 172.21.15.2:0/3000996287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48164720 msgr2=0x7f6b48168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f6b4d000640 1 --2- 172.21.15.2:0/3000996287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48164720 0x7f6b48168200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097a0 tx=0x7f6b3402a1a0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7de00b8a20 con 0x7f7df406c6f0 2024-05-14T15:16:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7deb400640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f7dd407fb70 0x7f7dd4082000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 --> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7de0032440 con 0x7f7dd407fb70 2024-05-14T15:16:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f6b4d000640 1 -- 172.21.15.2:0/3000996287 shutdown_connections 2024-05-14T15:16:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7bd6000640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7bc00763a0 0x7f7bc00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6b4d000640 1 --2- 172.21.15.2:0/3000996287 >> v2:172.21.15.156:3300/0 conn(0x7f6b48168740 0x7f6b4806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6b4d000640 1 --2- 172.21.15.2:0/3000996287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48164720 0x7f6b48168200 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fa22be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa2240d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fa22be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2240d11e0 con 0x7fa2241600a0 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fa22be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240d1550 con 0x7fa2240d4190 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fa22be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa22406c890 con 0x7fa2240d0890 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6b4d000640 1 -- 172.21.15.2:0/3000996287 >> 172.21.15.2:0/3000996287 conn(0x7f6b480ce230 msgr2=0x7f6b480ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7de00b8e10 con 0x7f7df406c6f0 2024-05-14T15:16:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f7df2a00640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dd40763a0 0x7f7dd40788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6192c00640 1 -- 172.21.15.2:0/3733188850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c15dd00 msgr2=0x7f618c0d50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6192c00640 1 --2- 172.21.15.2:0/3733188850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c15dd00 0x7f618c0d50d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f618c0d3d80 tx=0x7f617402a1a0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f7df3e00640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f7dd407fb70 0x7f7dd4082000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7bd0097ba0 con 0x7f7be0160b40 2024-05-14T15:16:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7bd6000640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7f7bc007fb70 0x7f7bc0082000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bd001ee50 con 0x7f7bc007fb70 2024-05-14T15:16:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7bd0097f90 con 0x7f7be0160b40 2024-05-14T15:16:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.169+0000 7fea70c00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fea5407fad0 0x7fea54081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7fa229400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2240d4190 0x7fa2240d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7fa229400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2240d4190 0x7fa2240d5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58676/0 (socket says 172.21.15.2:58676) 2024-05-14T15:16:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7fa228a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa2241600a0 0x7fa2240b9060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36800/0 (socket says 172.21.15.2:36800) 2024-05-14T15:16:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7fa228a00640 1 -- 172.21.15.2:0/2081747810 learned_addr learned my addr 172.21.15.2:0/2081747810 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6192c00640 1 -- 172.21.15.2:0/3733188850 shutdown_connections 2024-05-14T15:16:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6b4d000640 1 -- 172.21.15.2:0/3000996287 shutdown_connections 2024-05-14T15:16:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6192c00640 1 --2- 172.21.15.2:0/3733188850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06c6f0 0x7f618c06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6192c00640 1 --2- 172.21.15.2:0/3733188850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c15dd00 0x7f618c0d50d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6192c00640 1 -- 172.21.15.2:0/3733188850 >> 172.21.15.2:0/3733188850 conn(0x7f618c0d5aa0 msgr2=0x7f618c0d5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fea78a00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fea54076300 0x7fea54078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f7bdd400640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7f7bc007fb70 0x7f7bc0082000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f7bdde00640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7bc00763a0 0x7f7bc00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f6192c00640 1 -- 172.21.15.2:0/3733188850 shutdown_connections 2024-05-14T15:16:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa223e00640 1 -- 172.21.15.2:0/2081747810 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517982611 0 0) 0x7fa210001110 con 0x7fa2241600a0 2024-05-14T15:16:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa223e00640 1 -- 172.21.15.2:0/2081747810 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20c003520 con 0x7fa2241600a0 2024-05-14T15:16:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa229e00640 1 --2- 172.21.15.2:0/2081747810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa2240d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f6192c00640 1 -- 172.21.15.2:0/3733188850 wait complete. 2024-05-14T15:16:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f6b4d000640 1 -- 172.21.15.2:0/3000996287 wait complete. 2024-05-14T15:16:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f9c6ae00640 1 Processor -- start 2024-05-14T15:16:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.170+0000 7f915de00640 1 --2- 172.21.15.2:0/401796907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 0x7f91500060e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f914400bb40 tx=0x7f914402c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a1d492ba8fb8e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f9157e00640 1 -- 172.21.15.2:0/401796907 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144032770 con 0x7f915003a650 2024-05-14T15:16:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f9157e00640 1 -- 172.21.15.2:0/401796907 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144038070 con 0x7f915003a650 2024-05-14T15:16:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7f9157e00640 1 -- 172.21.15.2:0/401796907 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144032b30 con 0x7f915003a650 2024-05-14T15:16:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa229400640 1 -- 172.21.15.2:0/2081747810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 msgr2=0x7fa2240d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa229400640 1 --2- 172.21.15.2:0/2081747810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa2240d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa229400640 1 -- 172.21.15.2:0/2081747810 >> v1:172.21.15.2:6789/0 conn(0x7fa2241600a0 legacy=0x7fa2240b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.171+0000 7fa229400640 1 -- 172.21.15.2:0/2081747810 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22406cb70 con 0x7fa2240d4190 2024-05-14T15:16:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.172+0000 7f9c6ae00640 1 -- start start 2024-05-14T15:16:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.172+0000 7f915e800640 1 -- 172.21.15.2:0/401796907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 msgr2=0x7f91500060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.172+0000 7f915e800640 1 --2- 172.21.15.2:0/401796907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 0x7f91500060e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f914400bb40 tx=0x7f914402c870 comp rx=0 tx=0).stop 2024-05-14T15:16:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.172+0000 7f7df2a00640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dd40763a0 0x7f7dd40788b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7df4155530 tx=0x7f7de4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7f915e800640 1 -- 172.21.15.2:0/401796907 shutdown_connections 2024-05-14T15:16:13.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7f7bdde00640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7bc00763a0 0x7f7bc00788b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7bd803d000 tx=0x7f7bd8037000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7f915e800640 1 --2- 172.21.15.2:0/401796907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f915003a650 0x7f91500060e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7f915e800640 1 -- 172.21.15.2:0/401796907 >> 172.21.15.2:0/401796907 conn(0x7f9150054cf0 msgr2=0x7f9150055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7f915e800640 1 -- 172.21.15.2:0/401796907 shutdown_connections 2024-05-14T15:16:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.172+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 --> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea60032440 con 0x7fea5407fad0 2024-05-14T15:16:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.172+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fea600bf050 con 0x7fea74168740 2024-05-14T15:16:13.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7fea73e00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fea5407fad0 0x7fea54081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f6b4d000640 1 Processor -- start 2024-05-14T15:16:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7fea78a00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fea54076300 0x7fea54078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009fd0 tx=0x7fea6c0095c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7fa229400640 1 --2- 172.21.15.2:0/2081747810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2240d4190 0x7fa2240d5080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa218009d90 tx=0x7fa21802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437461960d954326 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.173+0000 7f915e800640 1 -- 172.21.15.2:0/401796907 wait complete. 2024-05-14T15:16:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f9c6ae00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c6406f8e0 0x7f9c6415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f9c6ae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c640ae7c0 0x7f9c641fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f9c6ae00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c641fa800 0x7f9c64166ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f6192c00640 1 Processor -- start 2024-05-14T15:16:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f9c6ae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c640d0ea0 con 0x7f9c640ae7c0 2024-05-14T15:16:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f9c6ae00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64168fc0 con 0x7f9c641fa800 2024-05-14T15:16:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f9c6ae00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6406fcf0 con 0x7f9c6406f8e0 2024-05-14T15:16:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f7df3e00640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f7dd407fb70 0x7f7dd4082000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f6192c00640 1 -- start start 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7fa223e00640 1 -- 172.21.15.2:0/2081747810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218007740 con 0x7fa2240d4190 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7fa223e00640 1 -- 172.21.15.2:0/2081747810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2180078e0 con 0x7fa2240d4190 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7fa223e00640 1 -- 172.21.15.2:0/2081747810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218007cb0 con 0x7fa2240d4190 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7f9c68e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c641fa800 0x7f9c64166ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7f9c5b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c640ae7c0 0x7f9c641fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7f9c68e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c641fa800 0x7f9c64166ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44726/0 (socket says 172.21.15.2:44726) 2024-05-14T15:16:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.175+0000 7f9c68e00640 1 -- 172.21.15.2:0/386177681 learned_addr learned my addr 172.21.15.2:0/386177681 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f7bdd400640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7f7bc007fb70 0x7f7bc0082000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7fea73e00640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fea5407fad0 0x7fea54081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.174+0000 7f6b4d000640 1 -- start start 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b4d000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b480ae7c0 0x7f6b481eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b4d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b48164720 0x7f6b48158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b4d000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48168740 0x7f6b48161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b4d000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4806cd50 con 0x7f6b48164720 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b4d000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4806ca70 con 0x7f6b480ae7c0 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b4d000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6b48168fc0 con 0x7f6b48168740 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b45400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b48164720 0x7f6b48158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f6b45400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b48164720 0x7f6b48158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58706/0 (socket says 172.21.15.2:58706) 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6192c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c06c6f0 0x7f618c0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6192c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06d590 0x7f618c153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6192c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f618c15dd00 0x7f618c1fa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6192c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0d45f0 con 0x7f618c06c6f0 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6192c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f618c06e0b0 con 0x7f618c15dd00 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6192c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0d48d0 con 0x7f618c06d590 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6b45e00640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b480ae7c0 0x7f6b481eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== osd.0 v2:172.21.15.2:6808/3972517232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7de0032440 con 0x7f7dd407fb70 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7fa22be00640 1 -- 172.21.15.2:0/2081747810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2240d4190 msgr2=0x7fa2240d5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7fa22be00640 1 --2- 172.21.15.2:0/2081747810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2240d4190 0x7fa2240d5080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa218009d90 tx=0x7fa21802a530 comp rx=0 tx=0).stop 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7fa22be00640 1 -- 172.21.15.2:0/2081747810 shutdown_connections 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7fa22be00640 1 --2- 172.21.15.2:0/2081747810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa2240d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7fa22be00640 1 --2- 172.21.15.2:0/2081747810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2240d4190 0x7fa2240d5080 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa218009d90 tx=0x7fa21802a530 comp rx=0 tx=0).stop 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7fa22be00640 1 -- 172.21.15.2:0/2081747810 >> 172.21.15.2:0/2081747810 conn(0x7fa2240d2dc0 msgr2=0x7fa2240d5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f618be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c06c6f0 0x7f618c0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f618be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c06c6f0 0x7f618c0cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58722/0 (socket says 172.21.15.2:58722) 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f618be00640 1 -- 172.21.15.2:0/1089841572 learned_addr learned my addr 172.21.15.2:0/1089841572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6190c00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f618c15dd00 0x7f618c1fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6b46800640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48168740 0x7f6b48161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.176+0000 7f9c63e00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c6406f8e0 0x7f9c6415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f9c68e00640 1 -- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c6406f8e0 msgr2=0x7f9c6415bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== osd.1 v2:172.21.15.2:6820/709711277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7bd001ee50 con 0x7f7bc007fb70 2024-05-14T15:16:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f9c68e00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c6406f8e0 0x7f9c6415bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f9c68e00640 1 -- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c640ae7c0 msgr2=0x7f9c641fa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7fa22be00640 1 -- 172.21.15.2:0/2081747810 shutdown_connections 2024-05-14T15:16:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7fa22be00640 1 -- 172.21.15.2:0/2081747810 wait complete. 2024-05-14T15:16:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f9c68e00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c640ae7c0 0x7f9c641fa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f9c68e00640 1 -- 172.21.15.2:0/386177681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6415c090 con 0x7f9c641fa800 2024-05-14T15:16:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f9c5b400640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c640ae7c0 0x7f9c641fa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f915e800640 1 Processor -- start 2024-05-14T15:16:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.177+0000 7f6b45400640 1 -- 172.21.15.2:0/119177078 learned_addr learned my addr 172.21.15.2:0/119177078 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f915e800640 1 -- start start 2024-05-14T15:16:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f9c68e00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c641fa800 0x7f9c64166ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00cc30 tx=0x7f9c5c00a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f618b400640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06d590 0x7f618c153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7f618be00640 1 -- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06d590 msgr2=0x7f618c153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f618be00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06d590 0x7f618c153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f618be00640 1 -- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f618c15dd00 msgr2=0x7f618c1fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f618be00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f618c15dd00 0x7f618c1fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f618be00640 1 -- 172.21.15.2:0/1089841572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c15b510 con 0x7f618c06c6f0 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f618b400640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f618c06d590 0x7f618c153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ce40 con 0x7f9c641fa800 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5c003990 con 0x7f9c641fa800 2024-05-14T15:16:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c003d40 con 0x7f9c641fa800 2024-05-14T15:16:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.180+0000 7f618be00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c06c6f0 0x7f618c0cb9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f617402a1e0 tx=0x7f61740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.180+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c641faf10 con 0x7f9c641fa800 2024-05-14T15:16:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.180+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174041070 con 0x7f618c06c6f0 2024-05-14T15:16:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.180+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617403c870 con 0x7f618c06c6f0 2024-05-14T15:16:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.180+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c15b7b0 con 0x7f618c06c6f0 2024-05-14T15:16:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.178+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== osd.2 v2:172.21.15.2:6815/216526144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea60032440 con 0x7fea5407fad0 2024-05-14T15:16:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.181+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c15bd70 con 0x7f618c06c6f0 2024-05-14T15:16:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.181+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037040 con 0x7f618c06c6f0 2024-05-14T15:16:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.180+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c641fb4d0 con 0x7f9c641fa800 2024-05-14T15:16:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.181+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c64050870 con 0x7f9c641fa800 2024-05-14T15:16:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f915e800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9150037b40 0x7f91500d4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f6b45400640 1 -- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48168740 msgr2=0x7f6b48161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f6b45400640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b48168740 0x7f6b48161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f6b45400640 1 -- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b480ae7c0 msgr2=0x7f6b481eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f6b45400640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b480ae7c0 0x7f6b481eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.179+0000 7f6b45400640 1 -- 172.21.15.2:0/119177078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b481fb210 con 0x7f6b48164720 2024-05-14T15:16:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f915e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f915003a650 0x7f91500c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f6b45400640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b48164720 0x7f6b48158db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6b340098c0 tx=0x7f6b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f915e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91500e3230 0x7f91500d6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f915d400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9150037b40 0x7f91500d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f915d400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9150037b40 0x7f91500d4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33530/0 (socket says 172.21.15.2:33530) 2024-05-14T15:16:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f915d400640 1 -- 172.21.15.2:0/3993229002 learned_addr learned my addr 172.21.15.2:0/3993229002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6164001030 con 0x7f618c06c6f0 2024-05-14T15:16:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34037050 con 0x7f6b48164720 2024-05-14T15:16:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.182+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b34043070 con 0x7f6b48164720 2024-05-14T15:16:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.183+0000 7f915ca00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f915003a650 0x7f91500c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.183+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91500e0e60 con 0x7f91500e3230 2024-05-14T15:16:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.183+0000 7f915de00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91500e3230 0x7f91500d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.183+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f91500e0ce0 con 0x7f915003a650 2024-05-14T15:16:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.183+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b481fb4f0 con 0x7f6b48164720 2024-05-14T15:16:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.184+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f91500e0fe0 con 0x7f9150037b40 2024-05-14T15:16:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.183+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6174044070 con 0x7f618c06c6f0 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f915ca00640 1 -- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9150037b40 msgr2=0x7f91500d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f915ca00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9150037b40 0x7f91500d4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f915ca00640 1 -- 172.21.15.2:0/3993229002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91500e3230 msgr2=0x7f91500d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f915ca00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91500e3230 0x7f91500d6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f915ca00640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91500c8570 con 0x7f915003a650 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.186+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c5c003ee0 con 0x7f9c641fa800 2024-05-14T15:16:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.186+0000 7f915ca00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f915003a650 0x7f91500c8030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c370 tx=0x7f914c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.184+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b481fbab0 con 0x7f6b48164720 2024-05-14T15:16:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.184+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3403cb30 con 0x7f6b48164720 2024-05-14T15:16:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f6183e00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6168076350 0x7f6168078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f61740b83a0 con 0x7f618c06c6f0 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f6183e00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f616807fb10 0x7f6168081fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 --> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6174007e80 con 0x7f616807fb10 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.185+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f61740bf050 con 0x7f618c06c6f0 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.186+0000 7f618b400640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6168076350 0x7f6168078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.186+0000 7f6190c00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f616807fb10 0x7f6168081fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c017070 con 0x7f915003a650 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9150175870 con 0x7f915003a650 2024-05-14T15:16:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91500e2750 con 0x7f915003a650 2024-05-14T15:16:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f6190c00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f616807fb10 0x7f6168081fa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c0052d0 con 0x7f915003a650 2024-05-14T15:16:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c003810 con 0x7f915003a650 2024-05-14T15:16:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7fa22be00640 1 Processor -- start 2024-05-14T15:16:13.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7f9c60c00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9c400762d0 0x7f9c400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.187+0000 7f618b400640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6168076350 0x7f6168078860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f618c15c8a0 tx=0x7f6184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c5c098300 con 0x7f9c641fa800 2024-05-14T15:16:13.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7f9c60c00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7f9c4007faa0 0x7f9c40081f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 --> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c40082600 con 0x7f9c4007faa0 2024-05-14T15:16:13.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9c5c0986f0 con 0x7f9c641fa800 2024-05-14T15:16:13.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.188+0000 7fa22be00640 1 -- start start 2024-05-14T15:16:13.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.189+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9134001030 con 0x7f915003a650 2024-05-14T15:16:13.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.189+0000 7f9c5b400640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7f9c4007faa0 0x7f9c40081f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.189+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b20001030 con 0x7f6b48164720 2024-05-14T15:16:13.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.189+0000 7f9c63e00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9c400762d0 0x7f9c400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.190+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b3403ccd0 con 0x7f6b48164720 2024-05-14T15:16:13.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.190+0000 7fa22be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa224158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.190+0000 7fa22be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2241600a0 0x7fa2240ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7fa22be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa22415b860 0x7fa2240af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7fa22be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240b9770 con 0x7fa2241600a0 2024-05-14T15:16:13.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7fa22be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa22406d130 con 0x7fa22415b860 2024-05-14T15:16:13.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7fa22be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa2241604b0 con 0x7fa2240d0890 2024-05-14T15:16:13.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7f9c63e00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9c400762d0 0x7f9c400787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c54034000 tx=0x7f9c5402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== osd.6 v2:172.21.15.156:6800/1299720883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6174007e80 con 0x7f616807fb10 2024-05-14T15:16:13.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7fa228a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2241600a0 0x7fa2240ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.192+0000 7fa229e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa22415b860 0x7fa2240af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.192+0000 7fa229400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa224158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.192+0000 7fa229400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa224158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33544/0 (socket says 172.21.15.2:33544) 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.192+0000 7fa229400640 1 -- 172.21.15.2:0/317401502 learned_addr learned my addr 172.21.15.2:0/317401502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.191+0000 7f9c5b400640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7f9c4007faa0 0x7f9c40081f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== osd.3 v2:172.21.15.2:6800/2884583722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c40082600 con 0x7f9c4007faa0 2024-05-14T15:16:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f914c01a070 con 0x7f915003a650 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7fa229400640 1 -- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa22415b860 msgr2=0x7fa2240af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7fa229400640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa22415b860 0x7fa2240af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7fa229400640 1 -- 172.21.15.2:0/317401502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2241600a0 msgr2=0x7fa2240ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.192+0000 7f6b3e000640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6b28076320 0x7f6b28078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.192+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6b340b8250 con 0x7f6b48164720 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f6b3e000640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7f6b2807fae0 0x7f6b28081f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 --> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b34041e80 con 0x7f6b2807fae0 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6b340bf050 con 0x7f6b48164720 2024-05-14T15:16:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f6b45e00640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6b28076320 0x7f6b28078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.193+0000 7f6b46800640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7f6b2807fae0 0x7f6b28081f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7f9155600640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f91380762d0 0x7f91380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7fa229400640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2241600a0 0x7fa2240ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7fa229400640 1 -- 172.21.15.2:0/317401502 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2241590f0 con 0x7fa2240d0890 2024-05-14T15:16:13.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7f6b45e00640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6b28076320 0x7f6b28078830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b38005880 tx=0x7f6b38006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7fa228a00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2241600a0 0x7fa2240ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f914c096f60 con 0x7f915003a650 2024-05-14T15:16:13.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7f9155600640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7f913807faa0 0x7f9138081f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f914c009e50 con 0x7f913807faa0 2024-05-14T15:16:13.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.195+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f914c097350 con 0x7f915003a650 2024-05-14T15:16:13.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.196+0000 7f6b46800640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7f6b2807fae0 0x7f6b28081f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.196+0000 7f915d400640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f91380762d0 0x7f91380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.196+0000 7fa229400640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa224158bb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa218009d90 tx=0x7fa218004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.196+0000 7f915de00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7f913807faa0 0x7f9138081f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.197+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218040070 con 0x7fa2240d0890 2024-05-14T15:16:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.197+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218031b40 con 0x7fa2240d0890 2024-05-14T15:16:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.197+0000 7fa22be00640 1 -- 172.21.15.2:0/317401502 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22415cbc0 con 0x7fa2240d0890 2024-05-14T15:16:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.197+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21803c420 con 0x7fa2240d0890 2024-05-14T15:16:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.197+0000 7fa22be00640 1 -- 172.21.15.2:0/317401502 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22415d180 con 0x7fa2240d0890 2024-05-14T15:16:13.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.197+0000 7f915d400640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f91380762d0 0x7f91380787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f915802e1c0 tx=0x7f915806a670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.198+0000 7f915de00640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7f913807faa0 0x7f9138081f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.198+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1f8001030 con 0x7fa2240d0890 2024-05-14T15:16:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.199+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== osd.7 v2:172.21.15.156:6808/784939538 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b34041e80 con 0x7f6b2807fae0 2024-05-14T15:16:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.202+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== osd.4 v2:172.21.15.156:6824/1273361273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f914c009e50 con 0x7f913807faa0 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.202+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa218039040 con 0x7fa2240d0890 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.204+0000 7fa221600640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa204076300 0x7fa204078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.205+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa21807e1c0 con 0x7fa2240d0890 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.205+0000 7fa221600640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7fa2040806f0 0x7fa204082be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.205+0000 7fa228a00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa204076300 0x7fa204078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.205+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 --> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2040832b0 con 0x7fa2040806f0 2024-05-14T15:16:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.205+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa21807e3c0 con 0x7fa2240d0890 2024-05-14T15:16:13.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.206+0000 7fa229e00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7fa2040806f0 0x7fa204082be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.206+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 --> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea74050870 con 0x7fea5407fad0 2024-05-14T15:16:13.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.207+0000 7fa228a00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa204076300 0x7fa204078810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa210005880 tx=0x7fa210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.207+0000 7fea70c00640 1 -- 172.21.15.2:0/3846238996 <== osd.2 v2:172.21.15.2:6815/216526144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fea74050870 con 0x7fea5407fad0 2024-05-14T15:16:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.207+0000 7fa229e00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7fa2040806f0 0x7fa204082be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.208+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fea5407fad0 msgr2=0x7fea54081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.208+0000 7fea6a000640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fea5407fad0 0x7fea54081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.210+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fea54076300 msgr2=0x7fea54078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.210+0000 7fea6a000640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fea54076300 0x7fea54078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009fd0 tx=0x7fea6c0095c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.210+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 msgr2=0x7fea740b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.210+0000 7fea6a000640 1 --2- 172.21.15.2:0/3846238996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea74168740 0x7fea740b1cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea600090b0 tx=0x7fea600046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.210+0000 7fea79400640 1 -- 172.21.15.2:0/3846238996 reap_dead start 2024-05-14T15:16:13.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.210+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== osd.5 v2:172.21.15.156:6816/1465481188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2040832b0 con 0x7fa2040806f0 2024-05-14T15:16:13.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.211+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 shutdown_connections 2024-05-14T15:16:13.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.211+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 >> 172.21.15.2:0/3846238996 conn(0x7fea740ce230 msgr2=0x7fea740b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.213+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 --> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7be00cfba0 con 0x7f7bc007fb70 2024-05-14T15:16:13.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.213+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 shutdown_connections 2024-05-14T15:16:13.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.213+0000 7fea6a000640 1 -- 172.21.15.2:0/3846238996 wait complete. 2024-05-14T15:16:13.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.214+0000 7f7bd6000640 1 -- 172.21.15.2:0/3671711638 <== osd.1 v2:172.21.15.2:6820/709711277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7be00cfba0 con 0x7f7bc007fb70 2024-05-14T15:16:13.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.215+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7f7bc007fb70 msgr2=0x7f7bc0082000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.215+0000 7f7be5000640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7f7bc007fb70 0x7f7bc0082000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.215+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7bc00763a0 msgr2=0x7f7bc00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.215+0000 7f7be5000640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7bc00763a0 0x7f7bc00788b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7bd803d000 tx=0x7f7bd8037000 comp rx=0 tx=0).stop 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be0160b40 msgr2=0x7f7be0159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7be5000640 1 --2- 172.21.15.2:0/3671711638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be0160b40 0x7f7be0159f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000c3c0 tx=0x7f7bd000c880 comp rx=0 tx=0).stop 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7bde800640 1 -- 172.21.15.2:0/3671711638 reap_dead start 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 shutdown_connections 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 >> 172.21.15.2:0/3671711638 conn(0x7f7be00d1910 msgr2=0x7f7be006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 shutdown_connections 2024-05-14T15:16:13.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.217+0000 7f7be5000640 1 -- 172.21.15.2:0/3671711638 wait complete. 2024-05-14T15:16:13.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.216+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 --> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7df40d4ce0 con 0x7f7dd407fb70 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.217+0000 7f7deb400640 1 -- 172.21.15.2:0/568233164 <== osd.0 v2:172.21.15.2:6808/3972517232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7df40d4ce0 con 0x7f7dd407fb70 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f7dd407fb70 msgr2=0x7f7dd4082000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df9000640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f7dd407fb70 0x7f7dd4082000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dd40763a0 msgr2=0x7f7dd40788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df9000640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dd40763a0 0x7f7dd40788b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7df4155530 tx=0x7f7de4009060 comp rx=0 tx=0).stop 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 msgr2=0x7f7df42060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df9000640 1 --2- 172.21.15.2:0/568233164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7df406c6f0 0x7f7df42060b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009960 tx=0x7f7de00046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.218+0000 7f7df3e00640 1 -- 172.21.15.2:0/568233164 reap_dead start 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.219+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 shutdown_connections 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.219+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 >> 172.21.15.2:0/568233164 conn(0x7f7df40d6050 msgr2=0x7f7df4167480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.219+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 shutdown_connections 2024-05-14T15:16:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.220+0000 7f7df9000640 1 -- 172.21.15.2:0/568233164 wait complete. 2024-05-14T15:16:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.226+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 --> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9134002dd0 con 0x7f913807faa0 2024-05-14T15:16:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.227+0000 7f9155600640 1 -- 172.21.15.2:0/3993229002 <== osd.4 v2:172.21.15.156:6824/1273361273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9134002dd0 con 0x7f913807faa0 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.228+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7f913807faa0 msgr2=0x7f9138081f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.228+0000 7f915e800640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7f913807faa0 0x7f9138081f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.229+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f91380762d0 msgr2=0x7f91380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.229+0000 7f915e800640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f91380762d0 0x7f91380787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f915802e1c0 tx=0x7f915806a670 comp rx=0 tx=0).stop 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.229+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f915003a650 msgr2=0x7f91500c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.229+0000 7f915e800640 1 --2- 172.21.15.2:0/3993229002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f915003a650 0x7f91500c8030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c370 tx=0x7f914c00c830 comp rx=0 tx=0).stop 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.229+0000 7f915de00640 1 -- 172.21.15.2:0/3993229002 reap_dead start 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.230+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 shutdown_connections 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.230+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 >> 172.21.15.2:0/3993229002 conn(0x7f9150054cf0 msgr2=0x7f91500df8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.230+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 shutdown_connections 2024-05-14T15:16:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.230+0000 7f915e800640 1 -- 172.21.15.2:0/3993229002 wait complete. 2024-05-14T15:16:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.230+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 --> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b20002dd0 con 0x7f6b2807fae0 2024-05-14T15:16:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.231+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 --> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9c6406f2f0 con 0x7f9c4007faa0 2024-05-14T15:16:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.231+0000 7f6b3e000640 1 -- 172.21.15.2:0/119177078 <== osd.7 v2:172.21.15.156:6808/784939538 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6b20002dd0 con 0x7f6b2807fae0 2024-05-14T15:16:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.232+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 --> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6164002dd0 con 0x7f616807fb10 2024-05-14T15:16:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.232+0000 7f9c60c00640 1 -- 172.21.15.2:0/386177681 <== osd.3 v2:172.21.15.2:6800/2884583722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9c6406f2f0 con 0x7f9c4007faa0 2024-05-14T15:16:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.232+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7f6b2807fae0 msgr2=0x7f6b28081f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.232+0000 7f6b4d000640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7f6b2807fae0 0x7f6b28081f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6b28076320 msgr2=0x7f6b28078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6b28076320 0x7f6b28078830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b38005880 tx=0x7f6b38006aa0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b48164720 msgr2=0x7f6b48158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 --2- 172.21.15.2:0/119177078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b48164720 0x7f6b48158db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6b340098c0 tx=0x7f6b340046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b46800640 1 -- 172.21.15.2:0/119177078 reap_dead start 2024-05-14T15:16:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 shutdown_connections 2024-05-14T15:16:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6183e00640 1 -- 172.21.15.2:0/1089841572 <== osd.6 v2:172.21.15.156:6800/1299720883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6164002dd0 con 0x7f616807fb10 2024-05-14T15:16:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 >> 172.21.15.2:0/119177078 conn(0x7f6b480ce230 msgr2=0x7f6b480aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.233+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 shutdown_connections 2024-05-14T15:16:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7f9c4007faa0 msgr2=0x7f9c40081f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7f9c4007faa0 0x7f9c40081f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f6b4d000640 1 -- 172.21.15.2:0/119177078 wait complete. 2024-05-14T15:16:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9c400762d0 msgr2=0x7f9c400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9c400762d0 0x7f9c400787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c54034000 tx=0x7f9c5402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c641fa800 msgr2=0x7f9c64166ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 --2- 172.21.15.2:0/386177681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c641fa800 0x7f9c64166ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00cc30 tx=0x7f9c5c00a5c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c68e00640 1 -- 172.21.15.2:0/386177681 reap_dead start 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 shutdown_connections 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 >> 172.21.15.2:0/386177681 conn(0x7f9c640ce230 msgr2=0x7f9c640b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f616807fb10 msgr2=0x7f6168081fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f6192c00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f616807fb10 0x7f6168081fa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6168076350 msgr2=0x7f6168078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.234+0000 7f6192c00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6168076350 0x7f6168078860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f618c15c8a0 tx=0x7f6184008040 comp rx=0 tx=0).stop 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c06c6f0 msgr2=0x7f618c0cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f6192c00640 1 --2- 172.21.15.2:0/1089841572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f618c06c6f0 0x7f618c0cb9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f617402a1e0 tx=0x7f61740046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f6190c00640 1 -- 172.21.15.2:0/1089841572 reap_dead start 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 shutdown_connections 2024-05-14T15:16:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 >> 172.21.15.2:0/1089841572 conn(0x7f618c0d5aa0 msgr2=0x7f618c0b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 shutdown_connections 2024-05-14T15:16:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f9c6ae00640 1 -- 172.21.15.2:0/386177681 wait complete. 2024-05-14T15:16:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.235+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 shutdown_connections 2024-05-14T15:16:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.236+0000 7f6192c00640 1 -- 172.21.15.2:0/1089841572 wait complete. 2024-05-14T15:16:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.245+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 --> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1f8002dd0 con 0x7fa2040806f0 2024-05-14T15:16:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.246+0000 7fa221600640 1 -- 172.21.15.2:0/317401502 <== osd.5 v2:172.21.15.156:6816/1465481188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1f8002dd0 con 0x7fa2040806f0 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.247+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7fa2040806f0 msgr2=0x7fa204082be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.247+0000 7fa216a00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7fa2040806f0 0x7fa204082be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa204076300 msgr2=0x7fa204078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa216a00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa204076300 0x7fa204078810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa210005880 tx=0x7fa210009040 comp rx=0 tx=0).stop 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 msgr2=0x7fa224158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa216a00640 1 --2- 172.21.15.2:0/317401502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2240d0890 0x7fa224158bb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa218009d90 tx=0x7fa218004a40 comp rx=0 tx=0).stop 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa229e00640 1 -- 172.21.15.2:0/317401502 reap_dead start 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 shutdown_connections 2024-05-14T15:16:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.248+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 >> 172.21.15.2:0/317401502 conn(0x7fa2240d2dc0 msgr2=0x7fa2240d4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.250+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 shutdown_connections 2024-05-14T15:16:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.250+0000 7fa216a00640 1 -- 172.21.15.2:0/317401502 wait complete. 2024-05-14T15:16:13.249 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:13.250 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T15:16:13.257 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:13.257 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:13.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T15:16:13.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T15:16:13.265 INFO:teuthology.orchestra.run.smithi002.stdout:60129542154 2024-05-14T15:16:13.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-14T15:16:13.269 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:13.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T15:16:13.270 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:13.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T15:16:13.279 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:13.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T15:16:13.281 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:13.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T15:16:13.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.662+0000 7f3310a00640 1 Processor -- start 2024-05-14T15:16:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.662+0000 7f3310a00640 1 -- start start 2024-05-14T15:16:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.666+0000 7f3310a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33040e3e20 0x7f3304054130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.667+0000 7f3310a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3304054a80 con 0x7f3304054670 2024-05-14T15:16:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.667+0000 7f3310a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3304006c60 con 0x7f33040ddff0 2024-05-14T15:16:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.667+0000 7f3310a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f3304006f40 con 0x7f33040e3e20 2024-05-14T15:16:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.667+0000 7f330aa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33040e3e20 0x7f3304054130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.667+0000 7f330b400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f33040ddff0 0x7f3304006410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.2:36968/0 (socket says 172.21.15.2:36968) 2024-05-14T15:16:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.667+0000 7f330b400640 1 -- 172.21.15.2:0/1670094073 learned_addr learned my addr 172.21.15.2:0/1670094073 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.669+0000 7f330aa00640 1 -- 172.21.15.2:0/1670094073 >> v1:172.21.15.156:6789/0 conn(0x7f33040ddff0 legacy=0x7f3304006410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.669+0000 7f330aa00640 1 -- 172.21.15.2:0/1670094073 >> v1:172.21.15.2:6789/0 conn(0x7f3304054670 legacy=0x7f3304057560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.669+0000 7f330aa00640 1 -- 172.21.15.2:0/1670094073 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3304007220 con 0x7f33040e3e20 2024-05-14T15:16:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.672+0000 7f330aa00640 1 --2- 172.21.15.2:0/1670094073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f3304054130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32f80097a0 tx=0x7f32f802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ef031d25af1588 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.673+0000 7f330a000640 1 -- 172.21.15.2:0/1670094073 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8037070 con 0x7f33040e3e20 2024-05-14T15:16:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.673+0000 7f330a000640 1 -- 172.21.15.2:0/1670094073 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f8032440 con 0x7f33040e3e20 2024-05-14T15:16:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.673+0000 7f330a000640 1 -- 172.21.15.2:0/1670094073 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8032850 con 0x7f33040e3e20 2024-05-14T15:16:13.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.675+0000 7f3310a00640 1 -- 172.21.15.2:0/1670094073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 msgr2=0x7f3304054130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.675+0000 7f3310a00640 1 --2- 172.21.15.2:0/1670094073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f3304054130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32f80097a0 tx=0x7f32f802a1c0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.675+0000 7f3310a00640 1 -- 172.21.15.2:0/1670094073 shutdown_connections 2024-05-14T15:16:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.675+0000 7f3310a00640 1 --2- 172.21.15.2:0/1670094073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f3304054130 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.675+0000 7f3310a00640 1 -- 172.21.15.2:0/1670094073 >> 172.21.15.2:0/1670094073 conn(0x7f3304056400 msgr2=0x7f3304059210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.676+0000 7f3310a00640 1 -- 172.21.15.2:0/1670094073 shutdown_connections 2024-05-14T15:16:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.676+0000 7fecd2400640 1 Processor -- start 2024-05-14T15:16:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.676+0000 7f3310a00640 1 -- 172.21.15.2:0/1670094073 wait complete. 2024-05-14T15:16:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.676+0000 7f1fbb600640 1 Processor -- start 2024-05-14T15:16:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.676+0000 7fecd2400640 1 -- start start 2024-05-14T15:16:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.677+0000 7f1fbb600640 1 -- start start 2024-05-14T15:16:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.679+0000 7fecd2400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc074070 0x7feccc159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.679+0000 7fecd2400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feccc0aebf0 0x7feccc1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.679+0000 7fecd2400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feccc0b0bb0 con 0x7feccc0b6830 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.679+0000 7fecd2400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7feccc15d500 con 0x7feccc0aebf0 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.679+0000 7fecd2400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7feccc0b63a0 con 0x7feccc074070 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.680+0000 7feccbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feccc0b6830 0x7feccc15fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36816/0 (socket says 172.21.15.2:36816) 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.680+0000 7feccbe00640 1 -- 172.21.15.2:0/2309367365 learned_addr learned my addr 172.21.15.2:0/2309367365 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.680+0000 7f3310a00640 1 Processor -- start 2024-05-14T15:16:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.680+0000 7f1fbb600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fb4070ca0 0x7f1fb415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.680+0000 7fecd1000640 1 --2- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc074070 0x7feccc159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.680+0000 7f3310a00640 1 -- start start 2024-05-14T15:16:13.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7fecd1a00640 1 --2- 172.21.15.2:0/2309367365 >> v2:172.21.15.156:3300/0 conn(0x7feccc0aebf0 0x7feccc1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7f1fbb600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1fb406de10 0x7f1fb40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7feccb400640 1 -- 172.21.15.2:0/2309367365 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285372483 0 0) 0x7feccc0b0bb0 con 0x7feccc0b6830 2024-05-14T15:16:13.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7feccb400640 1 -- 172.21.15.2:0/2309367365 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecb0003520 con 0x7feccc0b6830 2024-05-14T15:16:13.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7fecd1a00640 1 -- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc074070 msgr2=0x7feccc159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7fecd1a00640 1 --2- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc074070 0x7feccc159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.681+0000 7fecd1a00640 1 -- 172.21.15.2:0/2309367365 >> v1:172.21.15.2:6789/0 conn(0x7feccc0b6830 legacy=0x7feccc15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7fecd1a00640 1 -- 172.21.15.2:0/2309367365 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc15cf60 con 0x7feccc0aebf0 2024-05-14T15:16:13.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7f1fbb600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb415d470 con 0x7f1fb4159bb0 2024-05-14T15:16:13.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7f1fb8c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fb4070ca0 0x7f1fb415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7f1fb8c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fb4070ca0 0x7f1fb415cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58744/0 (socket says 172.21.15.2:58744) 2024-05-14T15:16:13.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2657380200 learned_addr learned my addr 172.21.15.2:0/2657380200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7f1fb9600640 1 --2- 172.21.15.2:0/2657380200 >> v2:172.21.15.156:3300/0 conn(0x7f1fb406de10 0x7f1fb40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.682+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb415fc20 con 0x7f1fb4070ca0 2024-05-14T15:16:13.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.683+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb415ff00 con 0x7f1fb406de10 2024-05-14T15:16:13.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f3310a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 0x7f33040d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2657380200 >> v2:172.21.15.156:3300/0 conn(0x7f1fb406de10 msgr2=0x7f1fb40af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f1fb8c00640 1 --2- 172.21.15.2:0/2657380200 >> v2:172.21.15.156:3300/0 conn(0x7f1fb406de10 0x7f1fb40af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2657380200 >> v1:172.21.15.2:6789/0 conn(0x7f1fb4159bb0 legacy=0x7f1fb406d700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:16:13.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f3310a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33040ddff0 0x7f3304179ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f330b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 0x7f33040d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f330b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 0x7f33040d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58746/0 (socket says 172.21.15.2:58746) 2024-05-14T15:16:13.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f330b400640 1 -- 172.21.15.2:0/3417824187 learned_addr learned my addr 172.21.15.2:0/3417824187 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2657380200 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41601e0 con 0x7f1fb4070ca0 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.684+0000 7f3310a00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f33040dff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.685+0000 7f330aa00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33040ddff0 0x7f3304179ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.685+0000 7f3310a00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3304007d00 con 0x7f3304054670 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.685+0000 7f3310a00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f33040077e0 con 0x7f33040e3e20 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.685+0000 7f3310a00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f3304057c70 con 0x7f33040ddff0 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.686+0000 7f330be00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f33040dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.686+0000 7fecd1a00640 1 --2- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0aebf0 0x7feccc1601e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fecb80097a0 tx=0x7fecb802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0eb8a238bc9d19c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.686+0000 7f1fb8c00640 1 --2- 172.21.15.2:0/2657380200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4070ca0 0x7f1fb415cf30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1fb415c4b0 tx=0x7f1fac02ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f903031a85848f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.686+0000 7feccb400640 1 -- 172.21.15.2:0/2309367365 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8037070 con 0x7feccc0aebf0 2024-05-14T15:16:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7feccb400640 1 -- 172.21.15.2:0/2309367365 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8032440 con 0x7feccc0aebf0 2024-05-14T15:16:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7feccb400640 1 -- 172.21.15.2:0/2309367365 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8032810 con 0x7feccc0aebf0 2024-05-14T15:16:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7f330b400640 1 -- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33040ddff0 msgr2=0x7f3304179ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7f330b400640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33040ddff0 0x7f3304179ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7f330b400640 1 -- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 msgr2=0x7f33040dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7f330b400640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f33040dff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.687+0000 7f330b400640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3304038ce0 con 0x7f3304054670 2024-05-14T15:16:13.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7f1fb3400640 1 -- 172.21.15.2:0/2657380200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac033070 con 0x7f1fb4070ca0 2024-05-14T15:16:13.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7fecd2400640 1 -- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0aebf0 msgr2=0x7feccc1601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7fecd2400640 1 --2- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0aebf0 0x7feccc1601e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fecb80097a0 tx=0x7fecb802a1a0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7f330aa00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33040ddff0 0x7f3304179ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7f330be00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f33040dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7f1fb3400640 1 -- 172.21.15.2:0/2657380200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac00a4e0 con 0x7f1fb4070ca0 2024-05-14T15:16:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7f1fb3400640 1 -- 172.21.15.2:0/2657380200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00a8b0 con 0x7f1fb4070ca0 2024-05-14T15:16:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7fecd2400640 1 -- 172.21.15.2:0/2309367365 shutdown_connections 2024-05-14T15:16:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7fecd2400640 1 --2- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0aebf0 0x7feccc1601e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7fecd2400640 1 --2- 172.21.15.2:0/2309367365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc074070 0x7feccc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.688+0000 7fecd2400640 1 -- 172.21.15.2:0/2309367365 >> 172.21.15.2:0/2309367365 conn(0x7feccc073550 msgr2=0x7feccc073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7f330b400640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 0x7f33040d1100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f330000c3a0 tx=0x7f330000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7fecd2400640 1 -- 172.21.15.2:0/2309367365 shutdown_connections 2024-05-14T15:16:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300017070 con 0x7f3304054670 2024-05-14T15:16:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300005ce0 con 0x7f3304054670 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.690+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4070ca0 msgr2=0x7f1fb415cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.690+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2657380200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4070ca0 0x7f1fb415cf30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1fb415c4b0 tx=0x7f1fac02ba40 comp rx=0 tx=0).stop 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.690+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 shutdown_connections 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.690+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2657380200 >> v2:172.21.15.156:3300/0 conn(0x7f1fb406de10 0x7f1fb40af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.690+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2657380200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4070ca0 0x7f1fb415cf30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.690+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 >> 172.21.15.2:0/2657380200 conn(0x7f1fb4073350 msgr2=0x7f1fb4073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300007310 con 0x7f3304054670 2024-05-14T15:16:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7f3310a00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3304038fc0 con 0x7f3304054670 2024-05-14T15:16:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.691+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 shutdown_connections 2024-05-14T15:16:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.689+0000 7fecd2400640 1 -- 172.21.15.2:0/2309367365 wait complete. 2024-05-14T15:16:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.692+0000 7f1fbb600640 1 -- 172.21.15.2:0/2657380200 wait complete. 2024-05-14T15:16:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.692+0000 7fecd2400640 1 Processor -- start 2024-05-14T15:16:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.693+0000 7f3310a00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3304039580 con 0x7f3304054670 2024-05-14T15:16:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.693+0000 7fecd2400640 1 -- start start 2024-05-14T15:16:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.695+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e0005290 con 0x7f3304054670 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7f1fbb600640 1 Processor -- start 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.695+0000 7fecd2400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc074070 0x7feccc159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.695+0000 7fecd2400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0aebf0 0x7feccc174b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7fecd2400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 0x7feccc1705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7fecd2400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feccc159ea0 con 0x7feccc074070 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7fecd2400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7feccc0b0e50 con 0x7feccc0b6830 2024-05-14T15:16:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7fecd2400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7feccc160720 con 0x7feccc0aebf0 2024-05-14T15:16:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f330001a070 con 0x7f3304054670 2024-05-14T15:16:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7f1fbb600640 1 -- start start 2024-05-14T15:16:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7fecd1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc074070 0x7feccc159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.696+0000 7fecd1a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 0x7feccc1705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.697+0000 7fecd1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc074070 0x7feccc159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58762/0 (socket says 172.21.15.2:58762) 2024-05-14T15:16:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.697+0000 7fecd1a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 0x7feccc1705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44798/0 (socket says 172.21.15.2:44798) 2024-05-14T15:16:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.697+0000 7fecd1a00640 1 -- 172.21.15.2:0/3453760690 learned_addr learned my addr 172.21.15.2:0/3453760690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.697+0000 7feccbe00640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0aebf0 0x7feccc174b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7fecd1a00640 1 -- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0aebf0 msgr2=0x7feccc174b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7fecd1a00640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0aebf0 0x7feccc174b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7fecd1a00640 1 -- 172.21.15.2:0/3453760690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc074070 msgr2=0x7feccc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7fecd1a00640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc074070 0x7feccc159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7fecd1a00640 1 -- 172.21.15.2:0/3453760690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc16fcd0 con 0x7feccc0b6830 2024-05-14T15:16:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7f32ff400640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f32ec076320 0x7f32ec078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.698+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3300096a60 con 0x7f3304054670 2024-05-14T15:16:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.700+0000 7f330aa00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f32ec076320 0x7f32ec078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.700+0000 7f98c4800640 1 Processor -- start 2024-05-14T15:16:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fbb600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb4070ca0 0x7f1fb4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fbb600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4159bb0 0x7f1fb4152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fbb600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 0x7f1fb41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fbb600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb4071440 con 0x7f1fb4159bb0 2024-05-14T15:16:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fbb600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41607a0 con 0x7f1fb4070ca0 2024-05-14T15:16:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fbb600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb40715c0 con 0x7f1fb4157590 2024-05-14T15:16:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f98c4800640 1 -- start start 2024-05-14T15:16:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7fecd1a00640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 0x7feccc1705f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fecb80097a0 tx=0x7fecb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.701+0000 7f1fb9600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 0x7f1fb41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.702+0000 7f1fb3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4159bb0 0x7f1fb4152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.702+0000 7f1fb9600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 0x7f1fb41579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33574/0 (socket says 172.21.15.2:33574) 2024-05-14T15:16:13.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.702+0000 7f1fb9600640 1 -- 172.21.15.2:0/2037716903 learned_addr learned my addr 172.21.15.2:0/2037716903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.702+0000 7f1fb8c00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb4070ca0 0x7f1fb4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f330aa00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f32ec076320 0x7f32ec078830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32f8034000 tx=0x7f32f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 msgr2=0x7f1fb41579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f52c2a00640 1 Processor -- start 2024-05-14T15:16:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8041020 con 0x7feccc0b6830 2024-05-14T15:16:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb803d620 con 0x7feccc0b6830 2024-05-14T15:16:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8037040 con 0x7feccc0b6830 2024-05-14T15:16:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f1fb8c00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 0x7f1fb41579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc1587e0 con 0x7feccc0b6830 2024-05-14T15:16:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2037716903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4159bb0 msgr2=0x7f1fb4152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f1fb8c00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4159bb0 0x7f1fb4152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f1fb8c00640 1 -- 172.21.15.2:0/2037716903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41582c0 con 0x7f1fb4070ca0 2024-05-14T15:16:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.704+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc158da0 con 0x7feccc0b6830 2024-05-14T15:16:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.704+0000 7f98c4800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98bc0b0e50 0x7f98bc0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.704+0000 7f1fb9600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 0x7f1fb41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.704+0000 7f1fb3e00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4159bb0 0x7f1fb4152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.703+0000 7f52c2a00640 1 -- start start 2024-05-14T15:16:13.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c4800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98bc0b5b20 0x7f98bc073930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c1e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98bc0b0e50 0x7f98bc0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c1e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98bc0b0e50 0x7f98bc0b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58780/0 (socket says 172.21.15.2:58780) 2024-05-14T15:16:13.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c4800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98bc074280 con 0x7f98bc073e70 2024-05-14T15:16:13.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f1fb8c00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb4070ca0 0x7f1fb4159360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1fac032000 tx=0x7f1fac004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c1400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98bc0b5b20 0x7f98bc073930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f70a1400640 1 Processor -- start 2024-05-14T15:16:13.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c4800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f98bc0b5690 con 0x7f98bc0b0e50 2024-05-14T15:16:13.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c4800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f98bc0cf780 con 0x7f98bc0b5b20 2024-05-14T15:16:13.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.705+0000 7f98c1e00640 1 -- 172.21.15.2:0/1536705346 learned_addr learned my addr 172.21.15.2:0/1536705346 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7f70a1400640 1 -- start start 2024-05-14T15:16:13.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac047070 con 0x7f1fb4070ca0 2024-05-14T15:16:13.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac038660 con 0x7f1fb4070ca0 2024-05-14T15:16:13.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac033050 con 0x7f1fb4070ca0 2024-05-14T15:16:13.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb41585a0 con 0x7f1fb4070ca0 2024-05-14T15:16:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52c2a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52bc0ae7c0 0x7f52bc164720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52c2a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc168910 0x7f52bc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52c2a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52bc0d1210 con 0x7f52bc06f8e0 2024-05-14T15:16:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52c2a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc0d14f0 con 0x7f52bc0ae7c0 2024-05-14T15:16:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52c2a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc06c790 con 0x7f52bc168910 2024-05-14T15:16:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f98c1e00640 1 -- 172.21.15.2:0/1536705346 >> v2:172.21.15.156:3300/0 conn(0x7f98bc0b5b20 msgr2=0x7f98bc073930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f98c1e00640 1 --2- 172.21.15.2:0/1536705346 >> v2:172.21.15.156:3300/0 conn(0x7f98bc0b5b20 0x7f98bc073930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f98c1e00640 1 -- 172.21.15.2:0/1536705346 >> v1:172.21.15.156:6789/0 conn(0x7f98bc073e70 legacy=0x7f98bc0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f98c1e00640 1 -- 172.21.15.2:0/1536705346 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc0b6a10 con 0x7f98bc0b0e50 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52bb400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f52bc06f8e0 0x7f52bc168200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36838/0 (socket says 172.21.15.2:36838) 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52bb400640 1 -- 172.21.15.2:0/1050355337 learned_addr learned my addr 172.21.15.2:0/1050355337 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.707+0000 7f52bbe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52bc0ae7c0 0x7f52bc164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb4158b60 con 0x7f1fb4070ca0 2024-05-14T15:16:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f70a1400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 0x7f709c164720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f70a1400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f709c168910 0x7f709c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f70a1400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0d1210 con 0x7f709c06f8e0 2024-05-14T15:16:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f70a1400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f709c0d14f0 con 0x7f709c168910 2024-05-14T15:16:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f70a1400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f709c06c790 con 0x7f709c0ae7c0 2024-05-14T15:16:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f52bbe00640 1 -- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc168910 msgr2=0x7f52bc06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.708+0000 7f52c0a00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc168910 0x7f52bc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7ff49b800640 1 Processor -- start 2024-05-14T15:16:13.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f52bbe00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc168910 0x7f52bc06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f52bbe00640 1 -- 172.21.15.2:0/1050355337 >> v1:172.21.15.2:6789/0 conn(0x7f52bc06f8e0 legacy=0x7f52bc168200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f52bbe00640 1 -- 172.21.15.2:0/1050355337 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc06ca70 con 0x7f52bc0ae7c0 2024-05-14T15:16:13.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f709a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 0x7f709c164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f709a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 0x7f709c164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33590/0 (socket says 172.21.15.2:33590) 2024-05-14T15:16:13.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f709a800640 1 -- 172.21.15.2:0/2750669001 learned_addr learned my addr 172.21.15.2:0/2750669001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb406da50 con 0x7f1fb4070ca0 2024-05-14T15:16:13.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f709b200640 1 --2- 172.21.15.2:0/2750669001 >> v2:172.21.15.2:3300/0 conn(0x7f709c168910 0x7f709c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7ff49b800640 1 -- start start 2024-05-14T15:16:13.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.710+0000 7f709a800640 1 -- 172.21.15.2:0/2750669001 >> v2:172.21.15.2:3300/0 conn(0x7f709c168910 msgr2=0x7f709c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.710+0000 7f709a800640 1 --2- 172.21.15.2:0/2750669001 >> v2:172.21.15.2:3300/0 conn(0x7f709c168910 0x7f709c06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.710+0000 7f709a800640 1 -- 172.21.15.2:0/2750669001 >> v1:172.21.15.2:6789/0 conn(0x7f709c06f8e0 legacy=0x7f709c168200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.710+0000 7f709a800640 1 -- 172.21.15.2:0/2750669001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c06ca70 con 0x7f709c0ae7c0 2024-05-14T15:16:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.710+0000 7f709b200640 1 --2- 172.21.15.2:0/2750669001 >> v2:172.21.15.2:3300/0 conn(0x7f709c168910 0x7f709c06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.709+0000 7f52c0a00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc168910 0x7f52bc06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.710+0000 7f98c1e00640 1 --2- 172.21.15.2:0/1536705346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc0b0e50 0x7f98bc0b63a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0d1700 tx=0x7f98ac02c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585ac4fd7d0c0b01 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.706+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc158530 con 0x7feccc0b6830 2024-05-14T15:16:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.711+0000 7f52bbe00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc164720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097a0 tx=0x7f52ac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814e502673a8ed29 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f709a800640 1 --2- 172.21.15.2:0/2750669001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 0x7f709c164720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7088009870 tx=0x7f708802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4e073532408ec1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fecb8044020 con 0x7feccc0b6830 2024-05-14T15:16:13.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f1374e00640 1 Processor -- start 2024-05-14T15:16:13.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f98c0a00640 1 -- 172.21.15.2:0/1536705346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac038070 con 0x7f98bc0b0e50 2024-05-14T15:16:13.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f98c0a00640 1 -- 172.21.15.2:0/1536705346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac031710 con 0x7f98bc0b0e50 2024-05-14T15:16:13.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f98c0a00640 1 -- 172.21.15.2:0/1536705346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac031ae0 con 0x7f98bc0b0e50 2024-05-14T15:16:13.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f1374e00640 1 -- start start 2024-05-14T15:16:13.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f330005f990 con 0x7f3304054670 2024-05-14T15:16:13.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f7099400640 1 -- 172.21.15.2:0/2750669001 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088037070 con 0x7f709c0ae7c0 2024-05-14T15:16:13.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f7099400640 1 -- 172.21.15.2:0/2750669001 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7088032440 con 0x7f709c0ae7c0 2024-05-14T15:16:13.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.712+0000 7f7099400640 1 -- 172.21.15.2:0/2750669001 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088032810 con 0x7f709c0ae7c0 2024-05-14T15:16:13.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7fecc8c00640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fecac076300 0x7fecac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fecb80b86c0 con 0x7feccc0b6830 2024-05-14T15:16:13.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7ff49b800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4941625e0 0x7ff49406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7ff49b800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49415e7f0 con 0x7ff4940d0ff0 2024-05-14T15:16:13.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7ff49b800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49415ead0 con 0x7ff4940b4ef0 2024-05-14T15:16:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7ff49b800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff49415f5b0 con 0x7ff4941625e0 2024-05-14T15:16:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7ff498e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff4940d0ff0 0x7ff4940b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36852/0 (socket says 172.21.15.2:36852) 2024-05-14T15:16:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7ff498e00640 1 -- 172.21.15.2:0/1383872423 learned_addr learned my addr 172.21.15.2:0/1383872423 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7f98c4800640 1 -- 172.21.15.2:0/1536705346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc0b0e50 msgr2=0x7f98bc0b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.713+0000 7f98c4800640 1 --2- 172.21.15.2:0/1536705346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc0b0e50 0x7f98bc0b63a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0d1700 tx=0x7f98ac02c460 comp rx=0 tx=0).stop 2024-05-14T15:16:13.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7fecd1000640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fecac076300 0x7fecac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7ff499800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4941625e0 0x7ff49406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f98c4800640 1 -- 172.21.15.2:0/1536705346 shutdown_connections 2024-05-14T15:16:13.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f98c4800640 1 --2- 172.21.15.2:0/1536705346 >> v2:172.21.15.156:3300/0 conn(0x7f98bc0b5b20 0x7f98bc073930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f98c4800640 1 --2- 172.21.15.2:0/1536705346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc0b0e50 0x7f98bc0b63a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f98c4800640 1 -- 172.21.15.2:0/1536705346 >> 172.21.15.2:0/1536705346 conn(0x7f98bc0d1910 msgr2=0x7f98bc0d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f70a1400640 1 -- 172.21.15.2:0/2750669001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 msgr2=0x7f709c164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f70a1400640 1 --2- 172.21.15.2:0/2750669001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 0x7f709c164720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7088009870 tx=0x7f708802a250 comp rx=0 tx=0).stop 2024-05-14T15:16:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f1374e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13700d0f10 0x7f1370160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f1374e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13700d3d80 0x7f137015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f1374e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13700d42f0 con 0x7f13700d5390 2024-05-14T15:16:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f1374e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f13700d4f00 con 0x7f13700d3d80 2024-05-14T15:16:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f98c4800640 1 -- 172.21.15.2:0/1536705346 shutdown_connections 2024-05-14T15:16:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f1374e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f13700d45d0 con 0x7f13700d0f10 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220095619 0 0) 0x7ff49415e7f0 con 0x7ff4940d0ff0 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff47c003520 con 0x7ff4940d0ff0 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f70a1400640 1 -- 172.21.15.2:0/2750669001 shutdown_connections 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f70a1400640 1 --2- 172.21.15.2:0/2750669001 >> v2:172.21.15.2:3300/0 conn(0x7f709c168910 0x7f709c06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f70a1400640 1 --2- 172.21.15.2:0/2750669001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c0ae7c0 0x7f709c164720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f70a1400640 1 -- 172.21.15.2:0/2750669001 >> 172.21.15.2:0/2750669001 conn(0x7f709c0ce230 msgr2=0x7f709c0ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7f70a1400640 1 -- 172.21.15.2:0/2750669001 shutdown_connections 2024-05-14T15:16:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.714+0000 7f98c4800640 1 -- 172.21.15.2:0/1536705346 wait complete. 2024-05-14T15:16:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7f70a1400640 1 -- 172.21.15.2:0/2750669001 wait complete. 2024-05-14T15:16:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3718947108 0 0) 0x7ff47c003520 con 0x7ff4940d0ff0 2024-05-14T15:16:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4941625e0 msgr2=0x7ff49406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4941625e0 0x7ff49406ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 >> v1:172.21.15.156:6789/0 conn(0x7ff4940b4ef0 legacy=0x7ff49406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49415edb0 con 0x7ff4940d0ff0 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7ff4880016f0 con 0x7ff4940d0ff0 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 >> v1:172.21.15.2:6789/0 conn(0x7ff4940d0ff0 legacy=0x7ff4940b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c003a30 0x7ff47c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff47c004800 0x7ff47c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff47c0051a0 0x7ff47c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff49415f5b0 con 0x7ff47c0051a0 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c00c110 con 0x7ff47c003a30 2024-05-14T15:16:13.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff47c00c310 con 0x7ff47c004800 2024-05-14T15:16:13.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7f136e800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13700d3d80 0x7f137015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7f136e800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13700d3d80 0x7f137015dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44834/0 (socket says 172.21.15.2:44834) 2024-05-14T15:16:13.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7f136e800640 1 -- 172.21.15.2:0/2812979627 learned_addr learned my addr 172.21.15.2:0/2812979627 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.715+0000 7f136d400640 1 --2- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13700d0f10 0x7f1370160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7fecd1000640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fecac076300 0x7fecac078810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009aa0 tx=0x7fecbc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7ff499800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4941625e0 0x7ff49406ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7ff498e00640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c003a30 0x7ff47c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7ff499800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff47c0051a0 0x7ff47c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7f136e800640 1 -- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13700d0f10 msgr2=0x7f1370160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7f136e800640 1 --2- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13700d0f10 0x7f1370160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7f136e800640 1 -- 172.21.15.2:0/2812979627 >> v1:172.21.15.156:6789/0 conn(0x7f13700d5390 legacy=0x7f13700d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7ff493e00640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff47c004800 0x7ff47c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.716+0000 7f136e800640 1 -- 172.21.15.2:0/2812979627 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13700d48b0 con 0x7f13700d3d80 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.717+0000 7ff499800640 1 -- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff47c004800 msgr2=0x7ff47c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.717+0000 7ff499800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff47c004800 0x7ff47c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.717+0000 7ff499800640 1 -- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c003a30 msgr2=0x7ff47c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.717+0000 7ff499800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c003a30 0x7ff47c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.717+0000 7ff499800640 1 -- 172.21.15.2:0/1383872423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49415edb0 con 0x7ff47c0051a0 2024-05-14T15:16:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.717+0000 7f70a1400640 1 Processor -- start 2024-05-14T15:16:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.718+0000 7f70a1400640 1 -- start start 2024-05-14T15:16:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.718+0000 7f136e800640 1 --2- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d3d80 0x7f137015dd40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1368009e50 tx=0x7f136802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ba62355e221ae1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.718+0000 7ff499800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff47c0051a0 0x7ff47c00b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4940d15f0 tx=0x7ff47c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a105f7709abf80 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.718+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c036070 con 0x7ff47c0051a0 2024-05-14T15:16:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.718+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c003b90 con 0x7ff47c0051a0 2024-05-14T15:16:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.718+0000 7ff493400640 1 -- 172.21.15.2:0/1383872423 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c009d60 con 0x7ff47c0051a0 2024-05-14T15:16:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.719+0000 7f98c4800640 1 Processor -- start 2024-05-14T15:16:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.719+0000 7ff49b800640 1 -- 172.21.15.2:0/1383872423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff47c0051a0 msgr2=0x7ff47c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.719+0000 7ff49b800640 1 --2- 172.21.15.2:0/1383872423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff47c0051a0 0x7ff47c00b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4940d15f0 tx=0x7ff47c005830 comp rx=0 tx=0).stop 2024-05-14T15:16:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.719+0000 7ff499800640 1 -- 172.21.15.2:0/1383872423 reap_dead start 2024-05-14T15:16:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.719+0000 7f98c4800640 1 -- start start 2024-05-14T15:16:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f70a1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 0x7f709c0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7ff49b800640 1 -- 172.21.15.2:0/1383872423 shutdown_connections 2024-05-14T15:16:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7ff49b800640 1 -- 172.21.15.2:0/1383872423 >> 172.21.15.2:0/1383872423 conn(0x7ff4940ce230 msgr2=0x7ff4940ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7ff49b800640 1 -- 172.21.15.2:0/1383872423 shutdown_connections 2024-05-14T15:16:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f70a1400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f709c0ae7c0 0x7f709c1fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7ff49b800640 1 -- 172.21.15.2:0/1383872423 wait complete. 2024-05-14T15:16:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f70a1400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c145d10 0x7f709c1ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f70a1400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0d0ea0 con 0x7f709c06f8e0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f70a1400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f709c168fc0 con 0x7f709c0ae7c0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f709a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 0x7f709c0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f70a1400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f709c06fcf0 con 0x7f709c145d10 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f709a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 0x7f709c0b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58798/0 (socket says 172.21.15.2:58798) 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f709a800640 1 -- 172.21.15.2:0/898540112 learned_addr learned my addr 172.21.15.2:0/898540112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.720+0000 7f7099e00640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f709c0ae7c0 0x7f709c1fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709b200640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c145d10 0x7f709c1ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709a800640 1 -- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c145d10 msgr2=0x7f709c1ee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709a800640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c145d10 0x7f709c1ee000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709a800640 1 -- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f709c0ae7c0 msgr2=0x7f709c1fe7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709a800640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f709c0ae7c0 0x7f709c1fe7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709a800640 1 -- 172.21.15.2:0/898540112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c0b4bb0 con 0x7f709c06f8e0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.721+0000 7f709a800640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 0x7f709c0b5c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7088009870 tx=0x7f70880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088041020 con 0x7f709c06f8e0 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c0b4e90 con 0x7f709c06f8e0 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f98c4800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc073e70 0x7f98bc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f98c4800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 0x7f98bc1e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f98c4800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98bc0b5b20 0x7f98bc0af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c4800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc0b5320 con 0x7f98bc073e70 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c4800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc0b5040 con 0x7f98bc0b0e50 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c4800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f98bc0b5f30 con 0x7f98bc0b5b20 2024-05-14T15:16:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c1400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 0x7f98bc1e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c0b5450 con 0x7f709c06f8e0 2024-05-14T15:16:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7088032440 con 0x7f709c06f8e0 2024-05-14T15:16:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.722+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088037040 con 0x7f709c06f8e0 2024-05-14T15:16:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c1400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 0x7f98bc1e5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44856/0 (socket says 172.21.15.2:44856) 2024-05-14T15:16:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c1400640 1 -- 172.21.15.2:0/3804270441 learned_addr learned my addr 172.21.15.2:0/3804270441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c1e00640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc073e70 0x7f98bc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7ff49b800640 1 Processor -- start 2024-05-14T15:16:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7ff49b800640 1 -- start start 2024-05-14T15:16:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7074005290 con 0x7f709c06f8e0 2024-05-14T15:16:13.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.723+0000 7f98c1400640 1 -- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98bc0b5b20 msgr2=0x7f98bc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.724+0000 7f98c1400640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98bc0b5b20 0x7f98bc0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.724+0000 7f98c1400640 1 -- 172.21.15.2:0/3804270441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc073e70 msgr2=0x7f98bc156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.724+0000 7f98c1400640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc073e70 0x7f98bc156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.724+0000 7f98c1400640 1 -- 172.21.15.2:0/3804270441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc1568d0 con 0x7f98bc0b0e50 2024-05-14T15:16:13.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.724+0000 7f98c1400640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 0x7f98bc1e5a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007e70 tx=0x7f98b800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.725+0000 7ff49b800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c0051a0 0x7ff494157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.725+0000 7ff49b800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 0x7ff494157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.725+0000 7ff49b800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4940ae7c0 0x7ff494158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.725+0000 7ff49b800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff49415be80 con 0x7ff4940af6b0 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.725+0000 7ff49b800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff494071640 con 0x7ff47c0051a0 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.725+0000 7ff49b800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff49415c000 con 0x7ff4940ae7c0 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff493e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 0x7ff494157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff493e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 0x7ff494157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58822/0 (socket says 172.21.15.2:58822) 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff493e00640 1 -- 172.21.15.2:0/1029206889 learned_addr learned my addr 172.21.15.2:0/1029206889 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff499800640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4940ae7c0 0x7ff494158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff498e00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c0051a0 0x7ff494157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7088044020 con 0x7f709c06f8e0 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff493e00640 1 -- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4940ae7c0 msgr2=0x7ff494158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.726+0000 7ff493e00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4940ae7c0 0x7ff494158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.727+0000 7ff493e00640 1 -- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c0051a0 msgr2=0x7ff494157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.727+0000 7ff493e00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c0051a0 0x7ff494157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.727+0000 7ff493e00640 1 -- 172.21.15.2:0/1029206889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940b0130 con 0x7ff4940af6b0 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.727+0000 7ff493e00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 0x7ff494157bd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff48400e580 tx=0x7ff48400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.727+0000 7f7092a00640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f707c0762d0 0x7f707c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f70880b8410 con 0x7f709c06f8e0 2024-05-14T15:16:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fecb804b030 con 0x7feccc0b6830 2024-05-14T15:16:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b8014620 con 0x7f98bc0b0e50 2024-05-14T15:16:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f7099e00640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f707c0762d0 0x7f707c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f136ca00640 1 -- 172.21.15.2:0/2812979627 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036070 con 0x7f13700d3d80 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f136ca00640 1 -- 172.21.15.2:0/2812979627 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368031600 con 0x7f13700d3d80 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f136ca00640 1 -- 172.21.15.2:0/2812979627 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13680319d0 con 0x7f13700d3d80 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98bc1e6490 con 0x7f98bc0b0e50 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b8019070 con 0x7f98bc0b0e50 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.728+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b80149c0 con 0x7f98bc0b0e50 2024-05-14T15:16:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.729+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98bc152ac0 con 0x7f98bc0b0e50 2024-05-14T15:16:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.729+0000 7f7099e00640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f707c0762d0 0x7f707c0787e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f709c1fde50 tx=0x7f708c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f1374e00640 1 -- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d3d80 msgr2=0x7f137015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f1374e00640 1 --2- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d3d80 0x7f137015dd40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1368009e50 tx=0x7f136802a730 comp rx=0 tx=0).stop 2024-05-14T15:16:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f52baa00640 1 -- 172.21.15.2:0/1050355337 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac037070 con 0x7f52bc0ae7c0 2024-05-14T15:16:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f1374e00640 1 -- 172.21.15.2:0/2812979627 shutdown_connections 2024-05-14T15:16:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f1374e00640 1 --2- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d3d80 0x7f137015dd40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f52baa00640 1 -- 172.21.15.2:0/1050355337 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac032440 con 0x7f52bc0ae7c0 2024-05-14T15:16:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f52baa00640 1 -- 172.21.15.2:0/1050355337 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac032810 con 0x7f52bc0ae7c0 2024-05-14T15:16:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f1374e00640 1 --2- 172.21.15.2:0/2812979627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13700d0f10 0x7f1370160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.730+0000 7f1374e00640 1 -- 172.21.15.2:0/2812979627 >> 172.21.15.2:0/2812979627 conn(0x7f13700d2d60 msgr2=0x7f137006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.731+0000 7f1374e00640 1 -- 172.21.15.2:0/2812979627 shutdown_connections 2024-05-14T15:16:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.731+0000 7f1374e00640 1 -- 172.21.15.2:0/2812979627 wait complete. 2024-05-14T15:16:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840052e0 con 0x7ff4940af6b0 2024-05-14T15:16:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484005480 con 0x7ff4940af6b0 2024-05-14T15:16:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484007020 con 0x7ff4940af6b0 2024-05-14T15:16:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f52c2a00640 1 -- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 msgr2=0x7f52bc164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f52c2a00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc164720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097a0 tx=0x7f52ac02a180 comp rx=0 tx=0).stop 2024-05-14T15:16:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f52c2a00640 1 -- 172.21.15.2:0/1050355337 shutdown_connections 2024-05-14T15:16:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f52c2a00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc168910 0x7f52bc06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.731+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98bc1e6200 con 0x7f98bc0b0e50 2024-05-14T15:16:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f708804b030 con 0x7f709c06f8e0 2024-05-14T15:16:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f52c2a00640 1 --2- 172.21.15.2:0/1050355337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc164720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f52c2a00640 1 -- 172.21.15.2:0/1050355337 >> 172.21.15.2:0/1050355337 conn(0x7f52bc0ce230 msgr2=0x7f52bc0ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.733+0000 7ff49b800640 1 -- 172.21.15.2:0/1029206889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4940afe50 con 0x7ff4940af6b0 2024-05-14T15:16:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.733+0000 7ff49b800640 1 -- 172.21.15.2:0/1029206889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49415fd80 con 0x7ff4940af6b0 2024-05-14T15:16:13.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.733+0000 7f52c2a00640 1 -- 172.21.15.2:0/1050355337 shutdown_connections 2024-05-14T15:16:13.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.733+0000 7f52c2a00640 1 -- 172.21.15.2:0/1050355337 wait complete. 2024-05-14T15:16:13.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.732+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1fac04a070 con 0x7f1fb4070ca0 2024-05-14T15:16:13.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.734+0000 7f1374e00640 1 Processor -- start 2024-05-14T15:16:13.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.734+0000 7f1fb0c00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1f900763a0 0x7f1f900788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.735+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1fac0b8c20 con 0x7f1fb4070ca0 2024-05-14T15:16:13.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.735+0000 7f1fb3e00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1f900763a0 0x7f1f900788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.735+0000 7f1374e00640 1 -- start start 2024-05-14T15:16:13.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.735+0000 7ff49b800640 1 -- 172.21.15.2:0/1029206889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4940cdc30 con 0x7ff4940af6b0 2024-05-14T15:16:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f52c2a00640 1 Processor -- start 2024-05-14T15:16:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1fb3e00640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1f900763a0 0x7f1f900788b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb415c1c0 tx=0x7f1f9c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f52c2a00640 1 -- start start 2024-05-14T15:16:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f52c2a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc06f8e0 0x7f52bc0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f52c2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f52c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 0x7f52bc159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1374e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 0x7f137014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1374e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d5390 0x7f13701610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1374e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1370161630 0x7f1370161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1374e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13700d1670 con 0x7f13700d3d80 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1374e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f13700d14f0 con 0x7f13700d5390 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.737+0000 7f1374e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f13700b4540 con 0x7f1370161630 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.738+0000 7f136de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 0x7f137014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.738+0000 7f136de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 0x7f137014f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58828/0 (socket says 172.21.15.2:58828) 2024-05-14T15:16:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f52c2a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc0d0ea0 con 0x7f52bc159720 2024-05-14T15:16:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f52c2a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc168fc0 con 0x7f52bc0ae7c0 2024-05-14T15:16:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f52c2a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc06fcf0 con 0x7f52bc06f8e0 2024-05-14T15:16:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.738+0000 7f136de00640 1 -- 172.21.15.2:0/1679322894 learned_addr learned my addr 172.21.15.2:0/1679322894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.738+0000 7f136d400640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d5390 0x7f13701610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f136e800640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1370161630 0x7f1370161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f136de00640 1 -- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1370161630 msgr2=0x7f1370161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f136de00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1370161630 0x7f1370161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f136de00640 1 -- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d5390 msgr2=0x7f13701610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f136de00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d5390 0x7f13701610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.739+0000 7f136de00640 1 -- 172.21.15.2:0/1679322894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137015b580 con 0x7f13700d3d80 2024-05-14T15:16:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7f136de00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 0x7f137014f880 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f135800c400 tx=0x7f135800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7f52c0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 0x7f52bc159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7f52c0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 0x7f52bc159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58842/0 (socket says 172.21.15.2:58842) 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7f52c0a00640 1 -- 172.21.15.2:0/717642656 learned_addr learned my addr 172.21.15.2:0/717642656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7f52bbe00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc06f8e0 0x7f52bc0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7f52bb400640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.741+0000 7f52c0a00640 1 -- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc06f8e0 msgr2=0x7f52bc0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.741+0000 7f52c0a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc06f8e0 0x7f52bc0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.741+0000 7f52c0a00640 1 -- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 msgr2=0x7f52bc149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.741+0000 7f52c0a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.741+0000 7f52c0a00640 1 -- 172.21.15.2:0/717642656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc15a070 con 0x7f52bc159720 2024-05-14T15:16:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.740+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff48401a020 con 0x7ff4940af6b0 2024-05-14T15:16:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.742+0000 7f52c0a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 0x7f52bc159b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52b400cd20 tx=0x7f52b400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.742+0000 7ff490c00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff4780763a0 0x7ff4780788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.742+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff4840979c0 con 0x7ff4940af6b0 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.743+0000 7ff498e00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff4780763a0 0x7ff4780788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.744+0000 7ff498e00640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff4780763a0 0x7ff4780788b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff488001920 tx=0x7ff488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.746+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1fb406da50 con 0x7f1fb4070ca0 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358017070 con 0x7f13700d3d80 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13580052d0 con 0x7f13700d3d80 2024-05-14T15:16:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13580037f0 con 0x7f13700d3d80 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b400f680 con 0x7f52bc159720 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b400f820 con 0x7f52bc159720 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b400fbf0 con 0x7f52bc159720 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc0b64d0 con 0x7f52bc159720 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.749+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc0b4ef0 con 0x7f52bc159720 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.750+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13700cf830 con 0x7f13700d3d80 2024-05-14T15:16:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.751+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1370150730 con 0x7f13700d3d80 2024-05-14T15:16:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.751+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff4940cdc30 con 0x7ff4940af6b0 2024-05-14T15:16:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.751+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc1684e0 con 0x7f52bc159720 2024-05-14T15:16:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.752+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98b8014b60 con 0x7f98bc0b0e50 2024-05-14T15:16:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.754+0000 7f98b6000640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f98a00762d0 0x7f98a00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.754+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f52b40213f0 con 0x7f52bc159720 2024-05-14T15:16:13.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.754+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f98b8098af0 con 0x7f98bc0b0e50 2024-05-14T15:16:13.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.752+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1370150240 con 0x7f13700d3d80 2024-05-14T15:16:13.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.755+0000 7f98c1e00640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f98a00762d0 0x7f98a00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.755+0000 7f52b3e00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f529c0763a0 0x7f529c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.756+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f52b4098da0 con 0x7f52bc159720 2024-05-14T15:16:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.756+0000 7f52bbe00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f529c0763a0 0x7f529c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.756+0000 7f98c1e00640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f98a00762d0 0x7f98a00787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98ac035000 tx=0x7f98ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.757+0000 7f52bbe00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f529c0763a0 0x7f529c0788b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52ac034000 tx=0x7f52ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.759+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98b8024020 con 0x7f98bc0b0e50 2024-05-14T15:16:13.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.760+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52bc1684e0 con 0x7f52bc159720 2024-05-14T15:16:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.764+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f135801a070 con 0x7f13700d3d80 2024-05-14T15:16:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.766+0000 7f1366000640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f134c076320 0x7f134c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.766+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1358097330 con 0x7f13700d3d80 2024-05-14T15:16:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.767+0000 7f136d400640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f134c076320 0x7f134c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.768+0000 7f136d400640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f134c076320 0x7f134c078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f137006d0d0 tx=0x7f1360008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:13.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:13.769+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f13580603e0 con 0x7f13700d3d80 2024-05-14T15:16:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.172+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f32e0005850 con 0x7f3304054670 2024-05-14T15:16:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.173+0000 7f32ff400640 1 -- 172.21.15.2:0/3417824187 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3300063c90 con 0x7f3304054670 2024-05-14T15:16:14.171 INFO:teuthology.orchestra.run.smithi002.stdout:64424509448 2024-05-14T15:16:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.177+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f32ec076320 msgr2=0x7f32ec078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.177+0000 7f32fcc00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f32ec076320 0x7f32ec078830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32f8034000 tx=0x7f32f802e000 comp rx=0 tx=0).stop 2024-05-14T15:16:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.177+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 msgr2=0x7f33040d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.177+0000 7f32fcc00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 0x7f33040d1100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f330000c3a0 tx=0x7f330000c860 comp rx=0 tx=0).stop 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.178+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 shutdown_connections 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.178+0000 7f32fcc00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f32ec076320 0x7f32ec078830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.178+0000 7f32fcc00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33040e3e20 0x7f33040dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.178+0000 7f32fcc00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33040ddff0 0x7f3304179ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.178+0000 7f32fcc00640 1 --2- 172.21.15.2:0/3417824187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3304054670 0x7f33040d1100 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.178+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 >> 172.21.15.2:0/3417824187 conn(0x7f3304056400 msgr2=0x7f330403e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.179+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 shutdown_connections 2024-05-14T15:16:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.179+0000 7f32fcc00640 1 -- 172.21.15.2:0/3417824187 wait complete. 2024-05-14T15:16:14.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.188+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feccc0b5bf0 con 0x7feccc0b6830 2024-05-14T15:16:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.189+0000 7fecc8c00640 1 -- 172.21.15.2:0/3453760690 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecb8081720 con 0x7feccc0b6830 2024-05-14T15:16:14.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.191+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7074005850 con 0x7f709c06f8e0 2024-05-14T15:16:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:14.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.192+0000 7f7092a00640 1 -- 172.21.15.2:0/898540112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7088081b50 con 0x7f709c06f8e0 2024-05-14T15:16:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:14.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fecac076300 msgr2=0x7fecac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fecac076300 0x7fecac078810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009aa0 tx=0x7fecbc009190 comp rx=0 tx=0).stop 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 msgr2=0x7feccc1705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 0x7feccc1705f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fecb80097a0 tx=0x7fecb80046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 shutdown_connections 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fecac076300 0x7fecac078810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0b6830 0x7feccc1705f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0aebf0 0x7feccc174b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 --2- 172.21.15.2:0/3453760690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc074070 0x7feccc159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 >> 172.21.15.2:0/3453760690 conn(0x7feccc073550 msgr2=0x7feccc0b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.193+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 shutdown_connections 2024-05-14T15:16:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.194+0000 7fecd2400640 1 -- 172.21.15.2:0/3453760690 wait complete. 2024-05-14T15:16:14.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.196+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f707c0762d0 msgr2=0x7f707c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.196+0000 7f70a1400640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f707c0762d0 0x7f707c0787e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f709c1fde50 tx=0x7f708c009040 comp rx=0 tx=0).stop 2024-05-14T15:16:14.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.196+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 msgr2=0x7f709c0b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.196+0000 7f70a1400640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 0x7f709c0b5c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7088009870 tx=0x7f70880046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.197+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 shutdown_connections 2024-05-14T15:16:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.197+0000 7f70a1400640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f707c0762d0 0x7f707c0787e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.197+0000 7f70a1400640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f709c0ae7c0 0x7f709c1fe7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.197+0000 7f70a1400640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f709c145d10 0x7f709c1ee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.197+0000 7f70a1400640 1 --2- 172.21.15.2:0/898540112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f709c06f8e0 0x7f709c0b5c50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.197+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 >> 172.21.15.2:0/898540112 conn(0x7f709c0ce230 msgr2=0x7f709c0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.198+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 shutdown_connections 2024-05-14T15:16:14.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.198+0000 7f70a1400640 1 -- 172.21.15.2:0/898540112 wait complete. 2024-05-14T15:16:14.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.207+0000 7ff49b800640 1 -- 172.21.15.2:0/1029206889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff4940afbe0 con 0x7ff4940af6b0 2024-05-14T15:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.209+0000 7ff490c00640 1 -- 172.21.15.2:0/1029206889 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff484061050 con 0x7ff4940af6b0 2024-05-14T15:16:14.210 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.212+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1fb4050870 con 0x7f1fb4070ca0 2024-05-14T15:16:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.212+0000 7ff482000640 1 -- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff4780763a0 msgr2=0x7ff4780788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.212+0000 7ff482000640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff4780763a0 0x7ff4780788b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff488001920 tx=0x7ff488009040 comp rx=0 tx=0).stop 2024-05-14T15:16:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.212+0000 7ff482000640 1 -- 172.21.15.2:0/1029206889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 msgr2=0x7ff494157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.212+0000 7ff482000640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 0x7ff494157bd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff48400e580 tx=0x7ff48400ea40 comp rx=0 tx=0).stop 2024-05-14T15:16:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 -- 172.21.15.2:0/1029206889 shutdown_connections 2024-05-14T15:16:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff4780763a0 0x7ff4780788b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4940ae7c0 0x7ff494158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4940af6b0 0x7ff494157bd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 --2- 172.21.15.2:0/1029206889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff47c0051a0 0x7ff494157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 -- 172.21.15.2:0/1029206889 >> 172.21.15.2:0/1029206889 conn(0x7ff4940ce230 msgr2=0x7ff494068710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7f1fb0c00640 1 -- 172.21.15.2:0/2037716903 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fac051020 con 0x7f1fb4070ca0 2024-05-14T15:16:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.213+0000 7ff482000640 1 -- 172.21.15.2:0/1029206889 shutdown_connections 2024-05-14T15:16:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.214+0000 7ff482000640 1 -- 172.21.15.2:0/1029206889 wait complete. 2024-05-14T15:16:14.213 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1f900763a0 msgr2=0x7f1f900788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1f900763a0 0x7f1f900788b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb415c1c0 tx=0x7f1f9c009060 comp rx=0 tx=0).stop 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb4070ca0 msgr2=0x7f1fb4159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb4070ca0 0x7f1fb4159360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1fac032000 tx=0x7f1fac004a40 comp rx=0 tx=0).stop 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 shutdown_connections 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1f900763a0 0x7f1f900788b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb4157590 0x7f1fb41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fb4159bb0 0x7f1fb4152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 --2- 172.21.15.2:0/2037716903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb4070ca0 0x7f1fb4159360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.216+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 >> 172.21.15.2:0/2037716903 conn(0x7f1fb4073350 msgr2=0x7f1fb40b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.217+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 shutdown_connections 2024-05-14T15:16:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.217+0000 7f1fbb600640 1 -- 172.21.15.2:0/2037716903 wait complete. 2024-05-14T15:16:14.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.219+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f98bc050870 con 0x7f98bc0b0e50 2024-05-14T15:16:14.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.220+0000 7f98b6000640 1 -- 172.21.15.2:0/3804270441 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98b8062070 con 0x7f98bc0b0e50 2024-05-14T15:16:14.219 INFO:teuthology.orchestra.run.smithi002.stdout:60129542153 2024-05-14T15:16:14.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.224+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f98a00762d0 msgr2=0x7f98a00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.224+0000 7f98c4800640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f98a00762d0 0x7f98a00787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98ac035000 tx=0x7f98ac008030 comp rx=0 tx=0).stop 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.224+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 msgr2=0x7f98bc1e5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.224+0000 7f98c4800640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 0x7f98bc1e5a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007e70 tx=0x7f98b800e4b0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 shutdown_connections 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f98a00762d0 0x7f98a00787e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc0b0e50 0x7f98bc1e5a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98bc0b5b20 0x7f98bc0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 --2- 172.21.15.2:0/3804270441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98bc073e70 0x7f98bc156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 >> 172.21.15.2:0/3804270441 conn(0x7f98bc0d1910 msgr2=0x7f98bc15ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 shutdown_connections 2024-05-14T15:16:14.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.225+0000 7f98c4800640 1 -- 172.21.15.2:0/3804270441 wait complete. 2024-05-14T15:16:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.235+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f52bc050870 con 0x7f52bc159720 2024-05-14T15:16:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.237+0000 7f52b3e00640 1 -- 172.21.15.2:0/717642656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52bc15a070 con 0x7f52bc159720 2024-05-14T15:16:14.236 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:14.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-05-14T15:16:14.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-05-14T15:16:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.239+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1370050870 con 0x7f13700d3d80 2024-05-14T15:16:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.239+0000 7f1366000640 1 -- 172.21.15.2:0/1679322894 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13580646e0 con 0x7f13700d3d80 2024-05-14T15:16:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f529c0763a0 msgr2=0x7f529c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.239 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f529c0763a0 0x7f529c0788b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52ac034000 tx=0x7f52ac02e000 comp rx=0 tx=0).stop 2024-05-14T15:16:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 msgr2=0x7f52bc159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 0x7f52bc159b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52b400cd20 tx=0x7f52b400a650 comp rx=0 tx=0).stop 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 shutdown_connections 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f529c0763a0 0x7f529c0788b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52bc0ae7c0 0x7f52bc149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52bc159720 0x7f52bc159b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.240+0000 7f52c2a00640 1 --2- 172.21.15.2:0/717642656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52bc06f8e0 0x7f52bc0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.241+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 >> 172.21.15.2:0/717642656 conn(0x7f52bc0ce230 msgr2=0x7f52bc168730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.241+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 shutdown_connections 2024-05-14T15:16:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.241+0000 7f52c2a00640 1 -- 172.21.15.2:0/717642656 wait complete. 2024-05-14T15:16:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.242+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f134c076320 msgr2=0x7f134c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f134c076320 0x7f134c078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f137006d0d0 tx=0x7f1360008040 comp rx=0 tx=0).stop 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 msgr2=0x7f137014f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 0x7f137014f880 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f135800c400 tx=0x7f135800c8c0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 shutdown_connections 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f134c076320 0x7f134c078830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13700d5390 0x7f13701610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1370161630 0x7f1370161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 --2- 172.21.15.2:0/1679322894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13700d3d80 0x7f137014f880 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 >> 172.21.15.2:0/1679322894 conn(0x7f13700d2d60 msgr2=0x7f137015f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 shutdown_connections 2024-05-14T15:16:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:14.243+0000 7f1374e00640 1 -- 172.21.15.2:0/1679322894 wait complete. 2024-05-14T15:16:14.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-05-14T15:16:14.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-05-14T15:16:14.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-05-14T15:16:14.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-05-14T15:16:14.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-05-14T15:16:15.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T15:16:15.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T15:16:15.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T15:16:15.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T15:16:15.250 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T15:16:15.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-14T15:16:15.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T15:16:15.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T15:16:15.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.647+0000 7f32c2200640 1 Processor -- start 2024-05-14T15:16:15.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.648+0000 7f32c2200640 1 -- start start 2024-05-14T15:16:15.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.652+0000 7f32c2200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.652+0000 7f32c2200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32bc15fa70 0x7f32bc15fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.652+0000 7f32c2200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32bc1603c0 con 0x7f32bc0af110 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.652+0000 7f32c2200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f32bc0b5f00 con 0x7f32bc15fa70 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.652+0000 7f32c2200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc0b6440 con 0x7f32bc159b40 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.653+0000 7f32c1800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32bc15fa70 0x7f32bc15fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.653+0000 7f32c1800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32bc15fa70 0x7f32bc15fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44906/0 (socket says 172.21.15.2:44906) 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.653+0000 7f32c1800640 1 -- 172.21.15.2:0/4185831568 learned_addr learned my addr 172.21.15.2:0/4185831568 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.654+0000 7f32bbe00640 1 --2- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.654+0000 7f32c1800640 1 -- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 msgr2=0x7f32bc0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.654+0000 7f32c1800640 1 --2- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc0b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.654+0000 7f32c1800640 1 -- 172.21.15.2:0/4185831568 >> v1:172.21.15.156:6789/0 conn(0x7f32bc0af110 legacy=0x7f32bc0b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.654+0000 7f32c1800640 1 -- 172.21.15.2:0/4185831568 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc0b6720 con 0x7f32bc15fa70 2024-05-14T15:16:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.656+0000 7f32c1800640 1 --2- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc15fe80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32a8013150 tx=0x7f32a80328e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d413549e31e6fb58 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.657+0000 7f32bb400640 1 -- 172.21.15.2:0/4185831568 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8035070 con 0x7f32bc15fa70 2024-05-14T15:16:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.657+0000 7f32bb400640 1 -- 172.21.15.2:0/4185831568 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a80114e0 con 0x7f32bc15fa70 2024-05-14T15:16:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.657+0000 7f32bb400640 1 -- 172.21.15.2:0/4185831568 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80116d0 con 0x7f32bc15fa70 2024-05-14T15:16:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.659+0000 7f32c2200640 1 -- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 msgr2=0x7f32bc15fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.659+0000 7f32c2200640 1 --2- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc15fe80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32a8013150 tx=0x7f32a80328e0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.659+0000 7f32c2200640 1 -- 172.21.15.2:0/4185831568 shutdown_connections 2024-05-14T15:16:15.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.659+0000 7f32c2200640 1 --2- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc15fe80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.659+0000 7f32c2200640 1 --2- 172.21.15.2:0/4185831568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.660+0000 7f32c2200640 1 -- 172.21.15.2:0/4185831568 >> 172.21.15.2:0/4185831568 conn(0x7f32bc0739a0 msgr2=0x7f32bc073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.660+0000 7f32c2200640 1 -- 172.21.15.2:0/4185831568 shutdown_connections 2024-05-14T15:16:15.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.663+0000 7f32c2200640 1 -- 172.21.15.2:0/4185831568 wait complete. 2024-05-14T15:16:15.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.672+0000 7f32c2200640 1 Processor -- start 2024-05-14T15:16:15.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.673+0000 7f32c2200640 1 -- start start 2024-05-14T15:16:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.676+0000 7f32c2200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc0af110 0x7f32bc146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.676+0000 7f32c2200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc1e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.677+0000 7f32c2200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc0cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.677+0000 7f32c2200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc071460 con 0x7f32bc0af110 2024-05-14T15:16:15.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.677+0000 7f32c2200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc0aebf0 con 0x7f32bc15fa70 2024-05-14T15:16:15.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.677+0000 7f32c2200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc0715e0 con 0x7f32bc159b40 2024-05-14T15:16:15.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.678+0000 7f32bbe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc1e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.678+0000 7f32bbe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc1e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33688/0 (socket says 172.21.15.2:33688) 2024-05-14T15:16:15.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.678+0000 7f32bbe00640 1 -- 172.21.15.2:0/2486156510 learned_addr learned my addr 172.21.15.2:0/2486156510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.678+0000 7f32c1800640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc0cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.679+0000 7f32c0e00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc0af110 0x7f32bc146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.680+0000 7f32c0e00640 1 -- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 msgr2=0x7f32bc1e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.680+0000 7f32c0e00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc1e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.680+0000 7f32c0e00640 1 -- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 msgr2=0x7f32bc0cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.681+0000 7f32c0e00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc0cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.681+0000 7f32c0e00640 1 -- 172.21.15.2:0/2486156510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc0ce0a0 con 0x7f32bc0af110 2024-05-14T15:16:15.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.682+0000 7f32c0e00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc0af110 0x7f32bc146fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32b400bd20 tx=0x7f32b400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.682+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4019070 con 0x7f32bc0af110 2024-05-14T15:16:15.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.682+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b4014440 con 0x7f32bc0af110 2024-05-14T15:16:15.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.682+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4014830 con 0x7f32bc0af110 2024-05-14T15:16:15.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.683+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc0ce380 con 0x7f32bc0af110 2024-05-14T15:16:15.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.683+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc0ce940 con 0x7f32bc0af110 2024-05-14T15:16:15.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.685+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32bc050870 con 0x7f32bc0af110 2024-05-14T15:16:15.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.693+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32b401c070 con 0x7f32bc0af110 2024-05-14T15:16:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.695+0000 7f32b8c00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f329c0763d0 0x7f329c0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.695+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f32b4097c90 con 0x7f32bc0af110 2024-05-14T15:16:15.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.698+0000 7f32bbe00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f329c0763d0 0x7f329c0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.699+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32b4023020 con 0x7f32bc0af110 2024-05-14T15:16:15.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.705+0000 7f32bbe00640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f329c0763d0 0x7f329c0788e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32bc157cc0 tx=0x7f32ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.707+0000 7efd4f400640 1 Processor -- start 2024-05-14T15:16:15.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.707+0000 7efd4f400640 1 -- start start 2024-05-14T15:16:15.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.710+0000 7efd4f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd480ae7c0 0x7efd48164720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.710+0000 7efd4f400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd4806f8e0 0x7efd48168200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.710+0000 7efd4f400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd48168b50 con 0x7efd48168740 2024-05-14T15:16:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.710+0000 7efd4f400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7efd480d1210 con 0x7efd480ae7c0 2024-05-14T15:16:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.710+0000 7efd4f400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7efd480d14f0 con 0x7efd4806f8e0 2024-05-14T15:16:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.711+0000 7fcc14e00640 1 Processor -- start 2024-05-14T15:16:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7fcc14e00640 1 -- start start 2024-05-14T15:16:15.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.711+0000 7eff3e600640 1 Processor -- start 2024-05-14T15:16:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7efd4d400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd48168740 0x7efd4806d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36854/0 (socket says 172.21.15.2:36854) 2024-05-14T15:16:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7efd4d400640 1 -- 172.21.15.2:0/1756229290 learned_addr learned my addr 172.21.15.2:0/1756229290 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7efd4ca00640 1 --2- 172.21.15.2:0/1756229290 >> v2:172.21.15.2:3300/0 conn(0x7efd480ae7c0 0x7efd48164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7fecb6400640 1 Processor -- start 2024-05-14T15:16:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7efd47e00640 1 --2- 172.21.15.2:0/1756229290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd4806f8e0 0x7efd48168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.713+0000 7fecb6400640 1 -- start start 2024-05-14T15:16:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.712+0000 7eff3e600640 1 -- start start 2024-05-14T15:16:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.714+0000 7efd47e00640 1 -- 172.21.15.2:0/1756229290 >> v2:172.21.15.2:3300/0 conn(0x7efd480ae7c0 msgr2=0x7efd48164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.714+0000 7efd47e00640 1 --2- 172.21.15.2:0/1756229290 >> v2:172.21.15.2:3300/0 conn(0x7efd480ae7c0 0x7efd48164720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.714+0000 7efd47e00640 1 -- 172.21.15.2:0/1756229290 >> v1:172.21.15.2:6789/0 conn(0x7efd48168740 legacy=0x7efd4806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.714+0000 7efd47e00640 1 -- 172.21.15.2:0/1756229290 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4806c790 con 0x7efd4806f8e0 2024-05-14T15:16:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.715+0000 7eff3e600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff380ae7c0 0x7eff38164790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.715+0000 7eff3e600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff38168380 con 0x7eff3806f8e0 2024-05-14T15:16:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.715+0000 7eff3e600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff38168660 con 0x7eff38073bf0 2024-05-14T15:16:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.715+0000 7eff3e600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7eff38168940 con 0x7eff380ae7c0 2024-05-14T15:16:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.715+0000 7efd4ca00640 1 --2- 172.21.15.2:0/1756229290 >> v2:172.21.15.2:3300/0 conn(0x7efd480ae7c0 0x7efd48164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7fecb6400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 0x7fecb00d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7eff36a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7eff3806f8e0 0x7eff380734e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36858/0 (socket says 172.21.15.2:36858) 2024-05-14T15:16:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7eff36a00640 1 -- 172.21.15.2:0/2519680238 learned_addr learned my addr 172.21.15.2:0/2519680238 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7eff37400640 1 --2- 172.21.15.2:0/2519680238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff380ae7c0 0x7eff38164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7fbb21000640 1 Processor -- start 2024-05-14T15:16:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7fecb6400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb00710b0 con 0x7fecb0073bf0 2024-05-14T15:16:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7fecb6400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb00cf9f0 con 0x7fecb00b5c70 2024-05-14T15:16:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.716+0000 7fecb6400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fecb00cfcd0 con 0x7fecb00b5860 2024-05-14T15:16:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fbb21000640 1 -- start start 2024-05-14T15:16:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc14e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc100715d0 0x7fcc100b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc14e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1015d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc14e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc100b4d60 con 0x7fcc1006f8e0 2024-05-14T15:16:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc14e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fcc100b4fd0 con 0x7fcc100715d0 2024-05-14T15:16:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc14e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcc100b52b0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fecafe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fecb0073bf0 0x7fecb015d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36874/0 (socket says 172.21.15.2:36874) 2024-05-14T15:16:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fecafe00640 1 -- 172.21.15.2:0/51595778 learned_addr learned my addr 172.21.15.2:0/51595778 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7efd47e00640 1 --2- 172.21.15.2:0/1756229290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd4806f8e0 0x7efd48168200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efd340097a0 tx=0x7efd3402a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4e6950d892ba61 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7eff36000640 1 -- 172.21.15.2:0/2519680238 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324550096 0 0) 0x7eff38168380 con 0x7eff3806f8e0 2024-05-14T15:16:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7eff36000640 1 -- 172.21.15.2:0/2519680238 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff1c003520 con 0x7eff3806f8e0 2024-05-14T15:16:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc0de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc100715d0 0x7fcc100b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc0d400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcc1006f8e0 0x7fcc1006fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.2:37062/0 (socket says 172.21.15.2:37062) 2024-05-14T15:16:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7fcc0d400640 1 -- 172.21.15.2:0/26311204 learned_addr learned my addr 172.21.15.2:0/26311204 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.718+0000 7fcc0e800640 1 --2- 172.21.15.2:0/26311204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7eff37400640 1 -- 172.21.15.2:0/2519680238 >> v1:172.21.15.156:6789/0 conn(0x7eff38073bf0 legacy=0x7eff3806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7eff37400640 1 -- 172.21.15.2:0/2519680238 >> v1:172.21.15.2:6789/0 conn(0x7eff3806f8e0 legacy=0x7eff380734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.717+0000 7eff37400640 1 -- 172.21.15.2:0/2519680238 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff38168c20 con 0x7eff380ae7c0 2024-05-14T15:16:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.718+0000 7efd47400640 1 -- 172.21.15.2:0/1756229290 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34037070 con 0x7efd4806f8e0 2024-05-14T15:16:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.718+0000 7efd47400640 1 -- 172.21.15.2:0/1756229290 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3402ad30 con 0x7efd4806f8e0 2024-05-14T15:16:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.718+0000 7efd47400640 1 -- 172.21.15.2:0/1756229290 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34032660 con 0x7efd4806f8e0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.718+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506050822 0 0) 0x7fecb00710b0 con 0x7fecb0073bf0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.718+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec94003520 con 0x7fecb0073bf0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecaf400640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 0x7fecb00d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2130849728 0 0) 0x7fec94003520 con 0x7fecb0073bf0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 msgr2=0x7fecb00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 0x7fecb00d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 >> v1:172.21.15.156:6789/0 conn(0x7fecb00b5c70 legacy=0x7fecb00734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb00cffb0 con 0x7fecb0073bf0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7feca0001a70 con 0x7fecb0073bf0 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 >> v1:172.21.15.2:6789/0 conn(0x7fecb0073bf0 legacy=0x7fecb015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec94003a80 0x7fec94003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 0x7fec94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec94004e60 0x7fec9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00cfcd0 con 0x7fec94003a80 2024-05-14T15:16:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fec94005590 con 0x7fec94004e60 2024-05-14T15:16:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fec9400bf00 con 0x7fecb00b5860 2024-05-14T15:16:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 -- 172.21.15.2:0/1756229290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd4806f8e0 msgr2=0x7efd48168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 --2- 172.21.15.2:0/1756229290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd4806f8e0 0x7efd48168200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efd340097a0 tx=0x7efd3402a0a0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7faf4fe00640 1 Processor -- start 2024-05-14T15:16:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fcc0e800640 1 -- 172.21.15.2:0/26311204 >> v2:172.21.15.156:3300/0 conn(0x7fcc100715d0 msgr2=0x7fcc100b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fcc0e800640 1 --2- 172.21.15.2:0/26311204 >> v2:172.21.15.156:3300/0 conn(0x7fcc100715d0 0x7fcc100b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fcc0e800640 1 -- 172.21.15.2:0/26311204 >> v1:172.21.15.156:6789/0 conn(0x7fcc1006f8e0 legacy=0x7fcc1006fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7fcc0e800640 1 -- 172.21.15.2:0/26311204 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100b5590 con 0x7fcc1015ccf0 2024-05-14T15:16:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.719+0000 7eff37400640 1 --2- 172.21.15.2:0/2519680238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff380ae7c0 0x7eff38164790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7eff30009dc0 tx=0x7eff3002a510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f601e28293780fb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7fbb21000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb1c160e10 0x7fbb1c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7fbb21000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c0b0210 0x7fbb1c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7eff36000640 1 -- 172.21.15.2:0/2519680238 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30007740 con 0x7eff380ae7c0 2024-05-14T15:16:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7eff36000640 1 -- 172.21.15.2:0/2519680238 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff300078e0 con 0x7eff380ae7c0 2024-05-14T15:16:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7eff36000640 1 -- 172.21.15.2:0/2519680238 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30007cb0 con 0x7eff380ae7c0 2024-05-14T15:16:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 -- 172.21.15.2:0/1756229290 shutdown_connections 2024-05-14T15:16:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 --2- 172.21.15.2:0/1756229290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd4806f8e0 0x7efd48168200 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 --2- 172.21.15.2:0/1756229290 >> v2:172.21.15.2:3300/0 conn(0x7efd480ae7c0 0x7efd48164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 -- 172.21.15.2:0/1756229290 >> 172.21.15.2:0/1756229290 conn(0x7efd480ce230 msgr2=0x7efd480ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7fbb21000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c0aec90 con 0x7fbb1c163a10 2024-05-14T15:16:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7faf4fe00640 1 -- start start 2024-05-14T15:16:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7fbb21000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c145660 con 0x7fbb1c160e10 2024-05-14T15:16:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7fbb21000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c1458b0 con 0x7fbb1c0b0210 2024-05-14T15:16:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7fecaea00640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 0x7fec94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fecaf400640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec94003a80 0x7fec94003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fcc0e800640 1 --2- 172.21.15.2:0/26311204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1015d100 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009d90 tx=0x7fcc0802a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e2f166b3239315 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fbb1aa00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c0b0210 0x7fbb1c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fbb1be00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbb1c163a10 0x7fbb1c163e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.2:37070/0 (socket says 172.21.15.2:37070) 2024-05-14T15:16:15.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fbb1be00640 1 -- 172.21.15.2:0/2971201822 learned_addr learned my addr 172.21.15.2:0/2971201822 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fecafe00640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec94004e60 0x7fec9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7fbb1b400640 1 --2- 172.21.15.2:0/2971201822 >> v2:172.21.15.2:3300/0 conn(0x7fbb1c160e10 0x7fbb1c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fecaf400640 1 -- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 msgr2=0x7fec94004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fecaf400640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb00b5860 0x7fec94004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fecaf400640 1 -- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec94004e60 msgr2=0x7fec9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fcc0ca00640 1 -- 172.21.15.2:0/26311204 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08007740 con 0x7fcc1015ccf0 2024-05-14T15:16:15.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fcc0ca00640 1 -- 172.21.15.2:0/26311204 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc080078e0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fcc0ca00640 1 -- 172.21.15.2:0/26311204 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08007cb0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fecaf400640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec94004e60 0x7fec9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fecaf400640 1 -- 172.21.15.2:0/51595778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec94003520 con 0x7fec94003a80 2024-05-14T15:16:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fbb1b400640 1 -- 172.21.15.2:0/2971201822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c0b0210 msgr2=0x7fbb1c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fbb1b400640 1 --2- 172.21.15.2:0/2971201822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c0b0210 0x7fbb1c0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fbb1b400640 1 -- 172.21.15.2:0/2971201822 >> v1:172.21.15.156:6789/0 conn(0x7fbb1c163a10 legacy=0x7fbb1c163e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.722+0000 7fbb1b400640 1 -- 172.21.15.2:0/2971201822 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c145b90 con 0x7fbb1c160e10 2024-05-14T15:16:15.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.723+0000 7fecaf400640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec94003a80 0x7fec94003ef0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec9800ba10 tx=0x7fec94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6eb4a19e71eb4e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.723+0000 7fcc14e00640 1 -- 172.21.15.2:0/26311204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 msgr2=0x7fcc1015d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.723+0000 7fcc14e00640 1 --2- 172.21.15.2:0/26311204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1015d100 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009d90 tx=0x7fcc0802a5b0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98030070 con 0x7fec94003a80 2024-05-14T15:16:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.723+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf48074040 0x7faf480b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7faf4fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf480b5b20 0x7faf480cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9802ae10 con 0x7fec94003a80 2024-05-14T15:16:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fecae000640 1 -- 172.21.15.2:0/51595778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9800b610 con 0x7fec94003a80 2024-05-14T15:16:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7faf4d400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf480b0e50 0x7faf48073930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36876/0 (socket says 172.21.15.2:36876) 2024-05-14T15:16:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.720+0000 7efd4f400640 1 -- 172.21.15.2:0/1756229290 shutdown_connections 2024-05-14T15:16:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.721+0000 7efd4f400640 1 -- 172.21.15.2:0/1756229290 wait complete. 2024-05-14T15:16:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7faf4d400640 1 -- 172.21.15.2:0/2656007207 learned_addr learned my addr 172.21.15.2:0/2656007207 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fcc14e00640 1 -- 172.21.15.2:0/26311204 shutdown_connections 2024-05-14T15:16:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fcc14e00640 1 --2- 172.21.15.2:0/26311204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1015d100 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fcc14e00640 1 --2- 172.21.15.2:0/26311204 >> v2:172.21.15.156:3300/0 conn(0x7fcc100715d0 0x7fcc100b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7fcc14e00640 1 -- 172.21.15.2:0/26311204 >> 172.21.15.2:0/26311204 conn(0x7fcc100ce230 msgr2=0x7fcc100ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7eff3e600640 1 -- 172.21.15.2:0/2519680238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff380ae7c0 msgr2=0x7eff38164790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7eff3e600640 1 --2- 172.21.15.2:0/2519680238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff380ae7c0 0x7eff38164790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7eff30009dc0 tx=0x7eff3002a510 comp rx=0 tx=0).stop 2024-05-14T15:16:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf480cf780 con 0x7faf480b0e50 2024-05-14T15:16:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7faf4ca00640 1 --2- 172.21.15.2:0/2656007207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf48074040 0x7faf480b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.724+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7faf480b5690 con 0x7faf480b5b20 2024-05-14T15:16:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7faf4de00640 1 --2- 172.21.15.2:0/2656007207 >> v2:172.21.15.156:3300/0 conn(0x7faf480b5b20 0x7faf480cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7efd4f400640 1 Processor -- start 2024-05-14T15:16:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7ff3cb200640 1 Processor -- start 2024-05-14T15:16:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7fcc14e00640 1 -- 172.21.15.2:0/26311204 shutdown_connections 2024-05-14T15:16:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7eff3e600640 1 -- 172.21.15.2:0/2519680238 shutdown_connections 2024-05-14T15:16:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7eff3e600640 1 --2- 172.21.15.2:0/2519680238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff380ae7c0 0x7eff38164790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7eff3e600640 1 -- 172.21.15.2:0/2519680238 >> 172.21.15.2:0/2519680238 conn(0x7eff380d1910 msgr2=0x7eff380d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7ff3cb200640 1 -- start start 2024-05-14T15:16:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7fecb6400640 1 -- 172.21.15.2:0/51595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec94003a80 msgr2=0x7fec94003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7fecb6400640 1 --2- 172.21.15.2:0/51595778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec94003a80 0x7fec94003ef0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec9800ba10 tx=0x7fec94005830 comp rx=0 tx=0).stop 2024-05-14T15:16:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7efd4f400640 1 -- start start 2024-05-14T15:16:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7eff3e600640 1 -- 172.21.15.2:0/2519680238 shutdown_connections 2024-05-14T15:16:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7faf47e00640 1 -- 172.21.15.2:0/2656007207 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482015257 0 0) 0x7faf480cf780 con 0x7faf480b0e50 2024-05-14T15:16:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7eff3e600640 1 -- 172.21.15.2:0/2519680238 wait complete. 2024-05-14T15:16:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7faf480b6a10 con 0x7faf48074040 2024-05-14T15:16:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7fbb1b400640 1 --2- 172.21.15.2:0/2971201822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c160e10 0x7fbb1c0ae750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009a00 tx=0x7fbb0c02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be6a73918412e95 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fbb1a000640 1 -- 172.21.15.2:0/2971201822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c037070 con 0x7fbb1c160e10 2024-05-14T15:16:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fbb1a000640 1 -- 172.21.15.2:0/2971201822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0c02ad60 con 0x7fbb1c160e10 2024-05-14T15:16:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fbb1a000640 1 -- 172.21.15.2:0/2971201822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c032660 con 0x7fbb1c160e10 2024-05-14T15:16:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7fecafe00640 1 -- 172.21.15.2:0/51595778 reap_dead start 2024-05-14T15:16:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.725+0000 7fcc14e00640 1 -- 172.21.15.2:0/26311204 wait complete. 2024-05-14T15:16:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fecb6400640 1 -- 172.21.15.2:0/51595778 shutdown_connections 2024-05-14T15:16:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fecb6400640 1 -- 172.21.15.2:0/51595778 >> 172.21.15.2:0/51595778 conn(0x7fecb00d1910 msgr2=0x7fecb00d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fecb6400640 1 -- 172.21.15.2:0/51595778 shutdown_connections 2024-05-14T15:16:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7faf47e00640 1 -- 172.21.15.2:0/2656007207 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf30004630 con 0x7faf480b0e50 2024-05-14T15:16:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.726+0000 7fecb6400640 1 -- 172.21.15.2:0/51595778 wait complete. 2024-05-14T15:16:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.727+0000 7faf4ca00640 1 -- 172.21.15.2:0/2656007207 >> v2:172.21.15.156:3300/0 conn(0x7faf480b5b20 msgr2=0x7faf480cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.727+0000 7faf4ca00640 1 --2- 172.21.15.2:0/2656007207 >> v2:172.21.15.156:3300/0 conn(0x7faf480b5b20 0x7faf480cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.727+0000 7faf4ca00640 1 -- 172.21.15.2:0/2656007207 >> v1:172.21.15.2:6789/0 conn(0x7faf480b0e50 legacy=0x7faf48073930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.727+0000 7faf4ca00640 1 -- 172.21.15.2:0/2656007207 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf480b4d60 con 0x7faf48074040 2024-05-14T15:16:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.727+0000 7fbb21000640 1 -- 172.21.15.2:0/2971201822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c160e10 msgr2=0x7fbb1c0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.727+0000 7fbb21000640 1 --2- 172.21.15.2:0/2971201822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c160e10 0x7fbb1c0ae750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009a00 tx=0x7fbb0c02a2e0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 0x7efd4815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd480ae7c0 0x7efd481f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4f400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd48168740 0x7efd481f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4f400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd48168fc0 con 0x7efd4806f8e0 2024-05-14T15:16:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4f400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7efd4806cd50 con 0x7efd480ae7c0 2024-05-14T15:16:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4f400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7efd480d0ea0 con 0x7efd48168740 2024-05-14T15:16:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7faf4ca00640 1 --2- 172.21.15.2:0/2656007207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf48074040 0x7faf480b63a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faf340097a0 tx=0x7faf3402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b4ab8c7e02881ee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7fbb21000640 1 -- 172.21.15.2:0/2971201822 shutdown_connections 2024-05-14T15:16:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7fbb21000640 1 --2- 172.21.15.2:0/2971201822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c0b0210 0x7fbb1c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7fbb21000640 1 --2- 172.21.15.2:0/2971201822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c160e10 0x7fbb1c0ae750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7fbb21000640 1 -- 172.21.15.2:0/2971201822 >> 172.21.15.2:0/2971201822 conn(0x7fbb1c073550 msgr2=0x7fbb1c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.728+0000 7efd4ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 0x7efd4815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7faf47e00640 1 -- 172.21.15.2:0/2656007207 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34037070 con 0x7faf48074040 2024-05-14T15:16:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7fbb21000640 1 -- 172.21.15.2:0/2971201822 shutdown_connections 2024-05-14T15:16:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7efd4ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 0x7efd4815f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58872/0 (socket says 172.21.15.2:58872) 2024-05-14T15:16:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7efd4ca00640 1 -- 172.21.15.2:0/541141140 learned_addr learned my addr 172.21.15.2:0/541141140 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7efd47e00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd480ae7c0 0x7efd481f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7ff3cb200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff3cc15d760 0x7ff3cc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7ff3cb200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3cc160c90 con 0x7ff3cc160720 2024-05-14T15:16:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7ff3cb200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3cc160f70 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7ff3cb200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7ff3cc15ab00 con 0x7ff3cc15d760 2024-05-14T15:16:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7faf47e00640 1 -- 172.21.15.2:0/2656007207 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3402ae40 con 0x7faf48074040 2024-05-14T15:16:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7faf47e00640 1 -- 172.21.15.2:0/2656007207 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34032660 con 0x7faf48074040 2024-05-14T15:16:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7fcc14e00640 1 Processor -- start 2024-05-14T15:16:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7fecb6400640 1 Processor -- start 2024-05-14T15:16:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7ff3c9e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff3cc160720 0x7ff3cc0b6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36884/0 (socket says 172.21.15.2:36884) 2024-05-14T15:16:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7ff3c9e00640 1 -- 172.21.15.2:0/2941772822 learned_addr learned my addr 172.21.15.2:0/2941772822 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7efd4d400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd48168740 0x7efd481f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.729+0000 7fbb21000640 1 -- 172.21.15.2:0/2971201822 wait complete. 2024-05-14T15:16:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7fcc14e00640 1 -- start start 2024-05-14T15:16:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.730+0000 7fecb6400640 1 -- start start 2024-05-14T15:16:15.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7ff3ca800640 1 --2- 172.21.15.2:0/2941772822 >> v2:172.21.15.156:3300/0 conn(0x7ff3cc15d760 0x7ff3cc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf48074040 msgr2=0x7faf480b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7faf4fe00640 1 --2- 172.21.15.2:0/2656007207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf48074040 0x7faf480b63a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faf340097a0 tx=0x7faf3402a0f0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7efd4ca00640 1 -- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd48168740 msgr2=0x7efd481f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7efd4ca00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd48168740 0x7efd481f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7efd4ca00640 1 -- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd480ae7c0 msgr2=0x7efd481f7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7efd4ca00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd480ae7c0 0x7efd481f7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7efd4ca00640 1 -- 172.21.15.2:0/541141140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd481f6410 con 0x7efd4806f8e0 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.731+0000 7efd4ca00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 0x7efd4815f970 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd4000efc0 tx=0x7efd4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 shutdown_connections 2024-05-14T15:16:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7faf4fe00640 1 --2- 172.21.15.2:0/2656007207 >> v2:172.21.15.156:3300/0 conn(0x7faf480b5b20 0x7faf480cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7faf4fe00640 1 --2- 172.21.15.2:0/2656007207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf48074040 0x7faf480b63a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 >> 172.21.15.2:0/2656007207 conn(0x7faf480d1910 msgr2=0x7faf480d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7ff3ca800640 1 -- 172.21.15.2:0/2941772822 >> v1:172.21.15.156:6789/0 conn(0x7ff3cc0cdd80 legacy=0x7ff3cc0b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7ff3ca800640 1 -- 172.21.15.2:0/2941772822 >> v1:172.21.15.2:6789/0 conn(0x7ff3cc160720 legacy=0x7ff3cc0b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7ff3ca800640 1 -- 172.21.15.2:0/2941772822 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc163890 con 0x7ff3cc15d760 2024-05-14T15:16:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40018020 con 0x7efd4806f8e0 2024-05-14T15:16:15.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 shutdown_connections 2024-05-14T15:16:15.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40014680 con 0x7efd4806f8e0 2024-05-14T15:16:15.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40014a30 con 0x7efd4806f8e0 2024-05-14T15:16:15.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7faf4fe00640 1 -- 172.21.15.2:0/2656007207 wait complete. 2024-05-14T15:16:15.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd481f66f0 con 0x7efd4806f8e0 2024-05-14T15:16:15.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.733+0000 7fcc14e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc1006f8e0 0x7fcc1016a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.733+0000 7fbb21000640 1 Processor -- start 2024-05-14T15:16:15.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.733+0000 7fcc14e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc100715d0 0x7fcc1009b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.733+0000 7fcc14e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1009bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.732+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481f6cb0 con 0x7efd4806f8e0 2024-05-14T15:16:15.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7fcc0de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc1006f8e0 0x7fcc1016a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7fcc0de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc1006f8e0 0x7fcc1016a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44956/0 (socket says 172.21.15.2:44956) 2024-05-14T15:16:15.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7ff3ca800640 1 --2- 172.21.15.2:0/2941772822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc15db70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009d90 tx=0x7ff3c402a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24fc07e7a8ea417 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7fcc0de00640 1 -- 172.21.15.2:0/2667448101 learned_addr learned my addr 172.21.15.2:0/2667448101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7ff3c8a00640 1 -- 172.21.15.2:0/2941772822 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4032640 con 0x7ff3cc15d760 2024-05-14T15:16:15.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7ff3c8a00640 1 -- 172.21.15.2:0/2941772822 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c40327e0 con 0x7ff3cc15d760 2024-05-14T15:16:15.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7ff3c8a00640 1 -- 172.21.15.2:0/2941772822 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4032bb0 con 0x7ff3cc15d760 2024-05-14T15:16:15.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc100b5f10 con 0x7fcc100715d0 2024-05-14T15:16:15.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcc100b5d90 con 0x7fcc1006f8e0 2024-05-14T15:16:15.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fcc0e800640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1009bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecb6400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb009ef30 0x7fecb01504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecb6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 0x7fecb01f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecb6400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01f4310 0x7fecb01f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecb6400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00cf630 con 0x7fecb014db20 2024-05-14T15:16:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecb6400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fecb015ade0 con 0x7fecb009ef30 2024-05-14T15:16:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecb6400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fecb00cf7b0 con 0x7fecb01f4310 2024-05-14T15:16:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcc100b68e0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecaea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 0x7fecb01f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecaea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 0x7fecb01f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58886/0 (socket says 172.21.15.2:58886) 2024-05-14T15:16:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.735+0000 7fecaea00640 1 -- 172.21.15.2:0/4184120125 learned_addr learned my addr 172.21.15.2:0/4184120125 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecafe00640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01f4310 0x7fecb01f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecaea00640 1 -- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01f4310 msgr2=0x7fecb01f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecaea00640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01f4310 0x7fecb01f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7fbb21000640 1 -- start start 2024-05-14T15:16:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecaea00640 1 -- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb009ef30 msgr2=0x7fecb01504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fbb21000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c0b0210 0x7fbb1c09ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fbb21000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb1c160e10 0x7fbb1c141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fbb21000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 0x7fbb1c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fcc0d400640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc100715d0 0x7fcc1009b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecaea00640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb009ef30 0x7fecb01504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fbb21000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c146430 con 0x7fbb1c0b0210 2024-05-14T15:16:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecaea00640 1 -- 172.21.15.2:0/4184120125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb0153230 con 0x7fecb014db20 2024-05-14T15:16:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fbb21000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c146150 con 0x7fbb1c160e10 2024-05-14T15:16:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fbb21000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c0b0b60 con 0x7fbb1c163a10 2024-05-14T15:16:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.734+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd48050870 con 0x7efd4806f8e0 2024-05-14T15:16:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.736+0000 7fecafe00640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01f4310 0x7fecb01f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7ff3cb200640 1 -- 172.21.15.2:0/2941772822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 msgr2=0x7ff3cc15db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fbb1be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 0x7fbb1c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7ff3cb200640 1 --2- 172.21.15.2:0/2941772822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc15db70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009d90 tx=0x7ff3c402a480 comp rx=0 tx=0).stop 2024-05-14T15:16:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fcc0e800640 1 -- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc1006f8e0 msgr2=0x7fcc1016a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fcc0e800640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc1006f8e0 0x7fcc1016a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fcc0e800640 1 -- 172.21.15.2:0/2667448101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc100715d0 msgr2=0x7fcc1009b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fcc0e800640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc100715d0 0x7fcc1009b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fcc0e800640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc10203770 con 0x7fcc1015ccf0 2024-05-14T15:16:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fbb1be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 0x7fbb1c0cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33798/0 (socket says 172.21.15.2:33798) 2024-05-14T15:16:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fbb1be00640 1 -- 172.21.15.2:0/1089996390 learned_addr learned my addr 172.21.15.2:0/1089996390 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7eff3e600640 1 Processor -- start 2024-05-14T15:16:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7eff3e600640 1 -- start start 2024-05-14T15:16:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7ff3cb200640 1 -- 172.21.15.2:0/2941772822 shutdown_connections 2024-05-14T15:16:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7ff3cb200640 1 --2- 172.21.15.2:0/2941772822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc15db70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7ff3cb200640 1 -- 172.21.15.2:0/2941772822 >> 172.21.15.2:0/2941772822 conn(0x7ff3cc0739a0 msgr2=0x7ff3cc073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd4001b020 con 0x7efd4806f8e0 2024-05-14T15:16:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fbb1b400640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c0b0210 0x7fbb1c09ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fcc0e800640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1009bc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc08031000 tx=0x7fcc08004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.737+0000 7fecaea00640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 0x7fecb01f3dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feca800f820 tx=0x7feca800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fbb1be00640 1 -- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb1c160e10 msgr2=0x7fbb1c141120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T15:16:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fbb1be00640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb1c160e10 0x7fbb1c141120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fbb1be00640 1 -- 172.21.15.2:0/1089996390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c0b0210 msgr2=0x7fbb1c09ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fbb1be00640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c0b0210 0x7fbb1c09ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7fbb1be00640 1 -- 172.21.15.2:0/1089996390 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c0ce550 con 0x7fbb1c163a10 2024-05-14T15:16:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7ff3cb200640 1 -- 172.21.15.2:0/2941772822 shutdown_connections 2024-05-14T15:16:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7faf4fe00640 1 Processor -- start 2024-05-14T15:16:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.738+0000 7ff3cb200640 1 -- 172.21.15.2:0/2941772822 wait complete. 2024-05-14T15:16:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7fbb1be00640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 0x7fbb1c0cd860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c840 tx=0x7fbb1400cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08040070 con 0x7fcc1015ccf0 2024-05-14T15:16:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7faf4fe00640 1 -- start start 2024-05-14T15:16:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7efd44c00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efd280763a0 0x7efd280788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd40098740 con 0x7efd4806f8e0 2024-05-14T15:16:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc08031ac0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.740+0000 7efd47e00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efd280763a0 0x7efd280788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.739+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1016bc90 con 0x7fcc1015ccf0 2024-05-14T15:16:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.740+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08045460 con 0x7fcc1015ccf0 2024-05-14T15:16:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.740+0000 7eff3e600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff3806f8e0 0x7eff38166a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.740+0000 7eff3e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 0x7eff3815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.740+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc101484f0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.740+0000 7eff3e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff381672b0 0x7eff381676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff37e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff381672b0 0x7eff381676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff37400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff3806f8e0 0x7eff38166a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff36a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 0x7eff3815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff37400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff3806f8e0 0x7eff38166a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33804/0 (socket says 172.21.15.2:33804) 2024-05-14T15:16:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff36a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 0x7eff3815ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44974/0 (socket says 172.21.15.2:44974) 2024-05-14T15:16:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf480b0e50 0x7faf481fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 0x7faf4815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14018070 con 0x7fbb1c163a10 2024-05-14T15:16:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1400a5e0 con 0x7fbb1c163a10 2024-05-14T15:16:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400a9d0 con 0x7fbb1c163a10 2024-05-14T15:16:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1016be60 con 0x7fcc1015ccf0 2024-05-14T15:16:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff3e600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7eff3806fe70 con 0x7eff381672b0 2024-05-14T15:16:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.741+0000 7eff37400640 1 -- 172.21.15.2:0/1612308102 learned_addr learned my addr 172.21.15.2:0/1612308102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7eff3806fcf0 con 0x7eff380ae7c0 2024-05-14T15:16:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7eff3806fff0 con 0x7eff3806f8e0 2024-05-14T15:16:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7ff3cb200640 1 Processor -- start 2024-05-14T15:16:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7ff3cb200640 1 -- start start 2024-05-14T15:16:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf4815dd50 0x7faf480b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c09e340 con 0x7fbb1c163a10 2024-05-14T15:16:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c09e900 con 0x7fbb1c163a10 2024-05-14T15:16:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7efd47e00640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efd280763a0 0x7efd280788b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd34034000 tx=0x7efd3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7faf4fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf480b5f30 con 0x7faf480b0e50 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7faf4fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7faf480b5320 con 0x7faf480b5b20 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.742+0000 7faf4fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7faf4815c4d0 con 0x7faf4815dd50 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7faf4d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf480b0e50 0x7faf481fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7faf4ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 0x7faf4815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7eff37e00640 1 -- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff3806f8e0 msgr2=0x7eff38166a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7faf4ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 0x7faf4815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:44978/0 (socket says 172.21.15.2:44978) 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7faf4ca00640 1 -- 172.21.15.2:0/1807133464 learned_addr learned my addr 172.21.15.2:0/1807133464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7eff37e00640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff3806f8e0 0x7eff38166a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7eff37e00640 1 -- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 msgr2=0x7eff3815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7eff37e00640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 0x7eff3815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7eff37e00640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff38167c00 con 0x7eff381672b0 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7eff36a00640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 0x7eff3815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.743+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c0ce2a0 con 0x7fbb1c163a10 2024-05-14T15:16:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4de00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf4815dd50 0x7faf480b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4d400640 1 -- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf4815dd50 msgr2=0x7faf480b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4d400640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf4815dd50 0x7faf480b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4d400640 1 -- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 msgr2=0x7faf4815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4d400640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 0x7faf4815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4d400640 1 -- 172.21.15.2:0/1807133464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4815e540 con 0x7faf480b0e50 2024-05-14T15:16:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4ca00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 0x7faf4815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7faf4de00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf4815dd50 0x7faf480b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:15.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.744+0000 7eff37e00640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff381672b0 0x7eff381676c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff2800b550 tx=0x7eff2800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7faf4d400640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf480b0e50 0x7faf481fd0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b550 tx=0x7faf3c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3cc0cdd80 0x7ff3cc15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 0x7ff3cc149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7ff3cb200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc161530 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7ff3cb200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc15d240 con 0x7ff3cc15d760 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.745+0000 7ff3cb200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b4d80 con 0x7ff3cc160720 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7ff3ca800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 0x7ff3cc149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28014070 con 0x7eff381672b0 2024-05-14T15:16:15.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c014070 con 0x7faf480b0e50 2024-05-14T15:16:15.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7ff3c9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3cc0cdd80 0x7ff3cc15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c009040 con 0x7faf480b0e50 2024-05-14T15:16:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00fa60 con 0x7faf480b0e50 2024-05-14T15:16:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd40022020 con 0x7efd4806f8e0 2024-05-14T15:16:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff38166fa0 con 0x7eff381672b0 2024-05-14T15:16:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff38159ec0 con 0x7eff381672b0 2024-05-14T15:16:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc08039040 con 0x7fcc1015ccf0 2024-05-14T15:16:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff28010680 con 0x7eff381672b0 2024-05-14T15:16:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28014070 con 0x7eff381672b0 2024-05-14T15:16:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7ff3ca800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 0x7ff3cc149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:33822/0 (socket says 172.21.15.2:33822) 2024-05-14T15:16:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7ff3ca800640 1 -- 172.21.15.2:0/3560146291 learned_addr learned my addr 172.21.15.2:0/3560146291 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80052e0 con 0x7fecb014db20 2024-05-14T15:16:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.748+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb1401b070 con 0x7fbb1c163a10 2024-05-14T15:16:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca8018070 con 0x7fecb014db20 2024-05-14T15:16:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.748+0000 7faf4fe00640 1 -- 172.21.15.2:0/1807133464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf481512f0 con 0x7faf480b0e50 2024-05-14T15:16:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca800d950 con 0x7fecb014db20 2024-05-14T15:16:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.749+0000 7faf4fe00640 1 -- 172.21.15.2:0/1807133464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf48152e50 con 0x7faf480b0e50 2024-05-14T15:16:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.746+0000 7ff3c9400640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7ff3c9e00640 1 -- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 msgr2=0x7ff3cc149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7ff3c9e00640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 0x7ff3cc149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7ff3c9e00640 1 -- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 msgr2=0x7ff3cc149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7ff3c9e00640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.750+0000 7fbb13400640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbafc076320 0x7fbafc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.747+0000 7ff3c9e00640 1 -- 172.21.15.2:0/3560146291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc15b1c0 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.749+0000 7ff3ca800640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 0x7ff3cc149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:15.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.750+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1c005290 con 0x7faf480b0e50 2024-05-14T15:16:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.750+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbb14097800 con 0x7fbb1c163a10 2024-05-14T15:16:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.749+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb014f700 con 0x7fecb014db20 2024-05-14T15:16:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.750+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb014fcc0 con 0x7fecb014db20 2024-05-14T15:16:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.751+0000 7ff3c9e00640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3cc0cdd80 0x7ff3cc15ac80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c500 tx=0x7ff3bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.751+0000 7fbb1b400640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbafc076320 0x7fbafc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.752+0000 7fcc06000640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcbec0763d0 0x7fcbec0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.751+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff28017070 con 0x7eff381672b0 2024-05-14T15:16:15.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.752+0000 7fbb1b400640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbafc076320 0x7fbafc078830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c034000 tx=0x7fbb0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.752+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcc080b93f0 con 0x7fcc1015ccf0 2024-05-14T15:16:15.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.752+0000 7eff2f400640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7eff180764d0 0x7eff180789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.752+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7eff280970d0 con 0x7eff381672b0 2024-05-14T15:16:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.753+0000 7fcc0de00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcbec0763d0 0x7fcbec0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.753+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf3c00fc00 con 0x7faf480b0e50 2024-05-14T15:16:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.753+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb0050870 con 0x7fecb014db20 2024-05-14T15:16:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.754+0000 7eff37400640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7eff180764d0 0x7eff180789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.754+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10005290 con 0x7eff381672b0 2024-05-14T15:16:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.754+0000 7fcc0de00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcbec0763d0 0x7fcbec0788e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009b00 tx=0x7fcc00009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.755+0000 7faf45600640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faf28076300 0x7faf28078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.755+0000 7eff37400640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7eff180764d0 0x7eff180789e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff3002a550 tx=0x7eff3002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.755+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf3c0981e0 con 0x7faf480b0e50 2024-05-14T15:16:15.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.756+0000 7faf4ca00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faf28076300 0x7faf28078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.757+0000 7faf4ca00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faf28076300 0x7faf28078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faf3402a130 tx=0x7faf3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.759+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faf3c061320 con 0x7faf480b0e50 2024-05-14T15:16:15.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.762+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feca800daf0 con 0x7fecb014db20 2024-05-14T15:16:15.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.764+0000 7feca7400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fec8c076320 0x7fec8c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.764+0000 7fecaf400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fec8c076320 0x7fec8c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.765+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc08054080 con 0x7fcc1015ccf0 2024-05-14T15:16:15.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.766+0000 7fecaf400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fec8c076320 0x7fec8c078830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fecb00d1700 tx=0x7fec9802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff38167c00 con 0x7eff381672b0 2024-05-14T15:16:15.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc007150 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3bc019030 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc007550 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc0b1490 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feca8014de0 con 0x7fecb014db20 2024-05-14T15:16:15.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.768+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc0b1a50 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.771+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc0afa30 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.779+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feca8061950 con 0x7fecb014db20 2024-05-14T15:16:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.781+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbb14060830 con 0x7fbb1c163a10 2024-05-14T15:16:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.779+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff3bc0047e0 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.786+0000 7ff3c2000640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff3ac0763a0 0x7ff3ac0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.786+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff3bc09fd50 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.787+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff3cc0afa30 con 0x7ff3cc0cdd80 2024-05-14T15:16:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.788+0000 7ff3c9400640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff3ac0763a0 0x7ff3ac0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:15.792+0000 7ff3c9400640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff3ac0763a0 0x7ff3ac0788b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0d0e30 tx=0x7ff3b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:16.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.147+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f32bc15d030 con 0x7f32bc0af110 2024-05-14T15:16:16.149 INFO:teuthology.orchestra.run.smithi002.stdout:64424509449 2024-05-14T15:16:16.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.148+0000 7f32b8c00640 1 -- 172.21.15.2:0/2486156510 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32b4060c40 con 0x7f32bc0af110 2024-05-14T15:16:16.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.152+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f329c0763d0 msgr2=0x7f329c0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.152+0000 7f32c2200640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f329c0763d0 0x7f329c0788e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32bc157cc0 tx=0x7f32ac008040 comp rx=0 tx=0).stop 2024-05-14T15:16:16.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.152+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc0af110 msgr2=0x7f32bc146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.152+0000 7f32c2200640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc0af110 0x7f32bc146fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32b400bd20 tx=0x7f32b400be10 comp rx=0 tx=0).stop 2024-05-14T15:16:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.153+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 shutdown_connections 2024-05-14T15:16:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.153+0000 7f32c2200640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f329c0763d0 0x7f329c0788e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.153+0000 7f32c2200640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32bc15fa70 0x7f32bc0cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.153+0000 7f32c2200640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32bc159b40 0x7f32bc1e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.153+0000 7f32c2200640 1 --2- 172.21.15.2:0/2486156510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc0af110 0x7f32bc146fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.153+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 >> 172.21.15.2:0/2486156510 conn(0x7f32bc0739a0 msgr2=0x7f32bc15de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.154+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 shutdown_connections 2024-05-14T15:16:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.154+0000 7f32c2200640 1 -- 172.21.15.2:0/2486156510 wait complete. 2024-05-14T15:16:16.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-05-14T15:16:16.191 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.203+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efd480cf2c0 con 0x7efd4806f8e0 2024-05-14T15:16:16.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.205+0000 7efd44c00640 1 -- 172.21.15.2:0/541141140 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd40010040 con 0x7efd4806f8e0 2024-05-14T15:16:16.203 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efd280763a0 msgr2=0x7efd280788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efd280763a0 0x7efd280788b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd34034000 tx=0x7efd3402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 msgr2=0x7efd4815f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 0x7efd4815f970 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd4000efc0 tx=0x7efd4000c490 comp rx=0 tx=0).stop 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 shutdown_connections 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efd280763a0 0x7efd280788b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd480ae7c0 0x7efd481f7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd48168740 0x7efd481f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 --2- 172.21.15.2:0/541141140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd4806f8e0 0x7efd4815f970 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.209+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 >> 172.21.15.2:0/541141140 conn(0x7efd480ce230 msgr2=0x7efd480b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.210+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 shutdown_connections 2024-05-14T15:16:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.210+0000 7efd4f400640 1 -- 172.21.15.2:0/541141140 wait complete. 2024-05-14T15:16:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.213+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faf1c005850 con 0x7faf480b0e50 2024-05-14T15:16:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.214+0000 7faf45600640 1 -- 172.21.15.2:0/1807133464 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf3c065620 con 0x7faf480b0e50 2024-05-14T15:16:16.214 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.217+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faf28076300 msgr2=0x7faf28078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.217+0000 7faf3aa00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faf28076300 0x7faf28078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faf3402a130 tx=0x7faf3402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.217+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf480b0e50 msgr2=0x7faf481fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.217+0000 7faf3aa00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf480b0e50 0x7faf481fd0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b550 tx=0x7faf3c00ba10 comp rx=0 tx=0).stop 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 shutdown_connections 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faf28076300 0x7faf28078810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf480b5b20 0x7faf4815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf4815dd50 0x7faf480b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 --2- 172.21.15.2:0/1807133464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf480b0e50 0x7faf481fd0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 >> 172.21.15.2:0/1807133464 conn(0x7faf480d1910 msgr2=0x7faf480b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 shutdown_connections 2024-05-14T15:16:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.218+0000 7faf3aa00640 1 -- 172.21.15.2:0/1807133464 wait complete. 2024-05-14T15:16:16.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.223+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff3cc050870 con 0x7ff3cc0cdd80 2024-05-14T15:16:16.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.224+0000 7ff3c2000640 1 -- 172.21.15.2:0/3560146291 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3bc068e50 con 0x7ff3cc0cdd80 2024-05-14T15:16:16.222 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:16.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.227+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7eff10005580 con 0x7eff381672b0 2024-05-14T15:16:16.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.227+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff3ac0763a0 msgr2=0x7ff3ac0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.227+0000 7ff3cb200640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff3ac0763a0 0x7ff3ac0788b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0d0e30 tx=0x7ff3b8009040 comp rx=0 tx=0).stop 2024-05-14T15:16:16.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.227+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3cc0cdd80 msgr2=0x7ff3cc15ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.227+0000 7ff3cb200640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3cc0cdd80 0x7ff3cc15ac80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c500 tx=0x7ff3bc00c9c0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 shutdown_connections 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff3ac0763a0 0x7ff3ac0788b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3cc15d760 0x7ff3cc149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3cc160720 0x7ff3cc149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 --2- 172.21.15.2:0/3560146291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3cc0cdd80 0x7ff3cc15ac80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 >> 172.21.15.2:0/3560146291 conn(0x7ff3cc0739a0 msgr2=0x7ff3cc1537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 shutdown_connections 2024-05-14T15:16:16.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.228+0000 7eff2f400640 1 -- 172.21.15.2:0/1612308102 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff28060000 con 0x7eff381672b0 2024-05-14T15:16:16.228 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:16.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.230+0000 7ff3cb200640 1 -- 172.21.15.2:0/3560146291 wait complete. 2024-05-14T15:16:16.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7eff180764d0 msgr2=0x7eff180789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7eff180764d0 0x7eff180789e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff3002a550 tx=0x7eff3002f000 comp rx=0 tx=0).stop 2024-05-14T15:16:16.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff381672b0 msgr2=0x7eff381676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff381672b0 0x7eff381676c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff2800b550 tx=0x7eff2800ba10 comp rx=0 tx=0).stop 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 shutdown_connections 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7eff180764d0 0x7eff180789e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff380ae7c0 0x7eff3815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff381672b0 0x7eff381676c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 --2- 172.21.15.2:0/1612308102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff3806f8e0 0x7eff38166a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 >> 172.21.15.2:0/1612308102 conn(0x7eff380d1910 msgr2=0x7eff380af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.232+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 shutdown_connections 2024-05-14T15:16:16.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.233+0000 7eff3e600640 1 -- 172.21.15.2:0/1612308102 wait complete. 2024-05-14T15:16:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.235+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcc1009f810 con 0x7fcc1015ccf0 2024-05-14T15:16:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.236+0000 7fcc06000640 1 -- 172.21.15.2:0/2667448101 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc1009f810 con 0x7fcc1015ccf0 2024-05-14T15:16:16.235 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.237+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbb1c050870 con 0x7fbb1c163a10 2024-05-14T15:16:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.238+0000 7fbb13400640 1 -- 172.21.15.2:0/1089996390 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb14067e20 con 0x7fbb1c163a10 2024-05-14T15:16:16.236 INFO:teuthology.orchestra.run.smithi002.stdout:60129542154 2024-05-14T15:16:16.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcbec0763d0 msgr2=0x7fcbec0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcbec0763d0 0x7fcbec0788e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009b00 tx=0x7fcc00009190 comp rx=0 tx=0).stop 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 msgr2=0x7fcc1009bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1009bc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc08031000 tx=0x7fcc08004a40 comp rx=0 tx=0).stop 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 shutdown_connections 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcbec0763d0 0x7fcbec0788e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc1015ccf0 0x7fcc1009bc00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc100715d0 0x7fcc1009b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 --2- 172.21.15.2:0/2667448101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc1006f8e0 0x7fcc1016a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.240+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 >> 172.21.15.2:0/2667448101 conn(0x7fcc100ce230 msgr2=0x7fcc1006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 shutdown_connections 2024-05-14T15:16:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fcc14e00640 1 -- 172.21.15.2:0/2667448101 wait complete. 2024-05-14T15:16:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbafc076320 msgr2=0x7fbafc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbafc076320 0x7fbafc078830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c034000 tx=0x7fbb0c02e000 comp rx=0 tx=0).stop 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 msgr2=0x7fbb1c0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 0x7fbb1c0cd860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c840 tx=0x7fbb1400cd00 comp rx=0 tx=0).stop 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 shutdown_connections 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbafc076320 0x7fbafc078830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb1c160e10 0x7fbb1c141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb1c163a10 0x7fbb1c0cd860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 --2- 172.21.15.2:0/1089996390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb1c0b0210 0x7fbb1c09ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 >> 172.21.15.2:0/1089996390 conn(0x7fbb1c073550 msgr2=0x7fbb1c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 shutdown_connections 2024-05-14T15:16:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.241+0000 7fbb21000640 1 -- 172.21.15.2:0/1089996390 wait complete. 2024-05-14T15:16:16.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-05-14T15:16:16.244 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.251+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fecb0160180 con 0x7fecb014db20 2024-05-14T15:16:16.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.252+0000 7feca7400640 1 -- 172.21.15.2:0/4184120125 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feca8061250 con 0x7fecb014db20 2024-05-14T15:16:16.250 INFO:teuthology.orchestra.run.smithi002.stdout:64424509450 2024-05-14T15:16:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fec8c076320 msgr2=0x7fec8c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fec8c076320 0x7fec8c078830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fecb00d1700 tx=0x7fec9802c000 comp rx=0 tx=0).stop 2024-05-14T15:16:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 msgr2=0x7fecb01f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 0x7fecb01f3dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feca800f820 tx=0x7feca800fce0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 shutdown_connections 2024-05-14T15:16:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fec8c076320 0x7fec8c078830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01f4310 0x7fecb01f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb014db20 0x7fecb01f3dd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.255+0000 7fecb6400640 1 --2- 172.21.15.2:0/4184120125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb009ef30 0x7fecb01504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.256+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 >> 172.21.15.2:0/4184120125 conn(0x7fecb00d1910 msgr2=0x7fecb00b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.256+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 shutdown_connections 2024-05-14T15:16:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.256+0000 7fecb6400640 1 -- 172.21.15.2:0/4184120125 wait complete. 2024-05-14T15:16:16.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-05-14T15:16:16.258 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-05-14T15:16:16.266 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-05-14T15:16:16.266 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-05-14T15:16:16.270 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2024-05-14T15:16:16.276 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-05-14T15:16:16.286 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:16.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T15:16:16.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:16:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.603+0000 7f5361600640 1 Processor -- start 2024-05-14T15:16:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.603+0000 7f5361600640 1 -- start start 2024-05-14T15:16:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.605+0000 7f5361600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f535c0b4dc0 0x7f535c0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.605+0000 7f5361600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f535c163bb0 0x7f535c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f5361600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535c0d48d0 con 0x7f535c0d4310 2024-05-14T15:16:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f5361600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f535c0d4bb0 con 0x7f535c0b4dc0 2024-05-14T15:16:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f5361600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f535c0d4e90 con 0x7f535c163bb0 2024-05-14T15:16:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f535c0b4dc0 0x7f535c0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f535c0b4dc0 0x7f535c0d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58946/0 (socket says 172.21.15.2:58946) 2024-05-14T15:16:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 -- 172.21.15.2:0/1687432993 learned_addr learned my addr 172.21.15.2:0/1687432993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535b400640 1 --2- 172.21.15.2:0/1687432993 >> v2:172.21.15.156:3300/0 conn(0x7f535c163bb0 0x7f535c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 -- 172.21.15.2:0/1687432993 >> v2:172.21.15.156:3300/0 conn(0x7f535c163bb0 msgr2=0x7f535c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 --2- 172.21.15.2:0/1687432993 >> v2:172.21.15.156:3300/0 conn(0x7f535c163bb0 0x7f535c0d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 -- 172.21.15.2:0/1687432993 >> v1:172.21.15.156:6789/0 conn(0x7f535c0d4310 legacy=0x7f535c160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.606+0000 7f535be00640 1 -- 172.21.15.2:0/1687432993 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c0d5170 con 0x7f535c0b4dc0 2024-05-14T15:16:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.607+0000 7f535be00640 1 --2- 172.21.15.2:0/1687432993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0b4dc0 0x7f535c0d0770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f535c08e960 tx=0x7f534402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fedb3f8dde93d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.608+0000 7f535aa00640 1 -- 172.21.15.2:0/1687432993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344037070 con 0x7f535c0b4dc0 2024-05-14T15:16:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.608+0000 7f535aa00640 1 -- 172.21.15.2:0/1687432993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344032440 con 0x7f535c0b4dc0 2024-05-14T15:16:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.608+0000 7f535aa00640 1 -- 172.21.15.2:0/1687432993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344032810 con 0x7f535c0b4dc0 2024-05-14T15:16:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.608+0000 7f5361600640 1 -- 172.21.15.2:0/1687432993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0b4dc0 msgr2=0x7f535c0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.608+0000 7f5361600640 1 --2- 172.21.15.2:0/1687432993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0b4dc0 0x7f535c0d0770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f535c08e960 tx=0x7f534402a1c0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.609+0000 7f5361600640 1 -- 172.21.15.2:0/1687432993 shutdown_connections 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.609+0000 7f5361600640 1 --2- 172.21.15.2:0/1687432993 >> v2:172.21.15.156:3300/0 conn(0x7f535c163bb0 0x7f535c0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.609+0000 7f5361600640 1 --2- 172.21.15.2:0/1687432993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0b4dc0 0x7f535c0d0770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.609+0000 7f5361600640 1 -- 172.21.15.2:0/1687432993 >> 172.21.15.2:0/1687432993 conn(0x7f535c0b7600 msgr2=0x7f535c0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.609+0000 7f5361600640 1 -- 172.21.15.2:0/1687432993 shutdown_connections 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.609+0000 7f5361600640 1 -- 172.21.15.2:0/1687432993 wait complete. 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.611+0000 7f5361600640 1 Processor -- start 2024-05-14T15:16:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.611+0000 7f5361600640 1 -- start start 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.612+0000 7f5361600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c0b4dc0 0x7f535c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5361600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 0x7f535c1fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5361600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c163bb0 0x7f535c1f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5361600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f535c06dcd0 con 0x7f535c0d4310 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5361600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f535c06db50 con 0x7f535c0b4dc0 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5361600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f535c06de50 con 0x7f535c163bb0 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 0x7f535c1fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 0x7f535c1fa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58956/0 (socket says 172.21.15.2:58956) 2024-05-14T15:16:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 -- 172.21.15.2:0/2343931768 learned_addr learned my addr 172.21.15.2:0/2343931768 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5360c00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c163bb0 0x7f535c1f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535be00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c0b4dc0 0x7f535c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 -- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c163bb0 msgr2=0x7f535c1f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c163bb0 0x7f535c1f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 -- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c0b4dc0 msgr2=0x7f535c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c0b4dc0 0x7f535c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535b400640 1 -- 172.21.15.2:0/2343931768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c1587c0 con 0x7f535c0d4310 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f5360c00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c163bb0 0x7f535c1f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.613+0000 7f535be00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c0b4dc0 0x7f535c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.614+0000 7f535b400640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 0x7f535c1fa090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f534c00cca0 tx=0x7f534c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.614+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c003990 con 0x7f535c0d4310 2024-05-14T15:16:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.614+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534c003b30 con 0x7f535c0d4310 2024-05-14T15:16:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.614+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c1ea8f0 con 0x7f535c0d4310 2024-05-14T15:16:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.614+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c004020 con 0x7f535c0d4310 2024-05-14T15:16:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.614+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c1eaeb0 con 0x7f535c0d4310 2024-05-14T15:16:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.615+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c0b7f40 con 0x7f535c0d4310 2024-05-14T15:16:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.617+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f534c0041c0 con 0x7f535c0d4310 2024-05-14T15:16:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.618+0000 7f5353e00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f53380762d0 0x7f53380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.618+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f534c097df0 con 0x7f535c0d4310 2024-05-14T15:16:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.618+0000 7f535be00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f53380762d0 0x7f53380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.620+0000 7f535be00640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f53380762d0 0x7f53380787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5344034000 tx=0x7f534402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.623+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f535c0b7f40 con 0x7f535c0d4310 2024-05-14T15:16:16.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.820+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f535c050870 con 0x7f53380762d0 2024-05-14T15:16:16.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.846+0000 7f5353e00640 1 -- 172.21.15.2:0/2343931768 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f535c050870 con 0x7f53380762d0 2024-05-14T15:16:16.851 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:16.853 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.853+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f53380762d0 msgr2=0x7f53380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.853+0000 7f5361600640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f53380762d0 0x7f53380787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5344034000 tx=0x7f534402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.853+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 msgr2=0x7f535c1fa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.853+0000 7f5361600640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 0x7f535c1fa090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f534c00cca0 tx=0x7f534c00a5c0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 shutdown_connections 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f53380762d0 0x7f53380787e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c163bb0 0x7f535c1f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f535c0d4310 0x7f535c1fa090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 --2- 172.21.15.2:0/2343931768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c0b4dc0 0x7f535c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 >> 172.21.15.2:0/2343931768 conn(0x7f535c0b7600 msgr2=0x7f535c160e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 shutdown_connections 2024-05-14T15:16:16.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:16.854+0000 7f5361600640 1 -- 172.21.15.2:0/2343931768 wait complete. 2024-05-14T15:16:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-14T15:16:14.855767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":150,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244476,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730244,"statfs":{"total":773094113280,"available":772843769856,"internally_reserved":0,"allocated":3416064,"data_stored":2034928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006588"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501523+0000","last_change":"2024-05-14T15:15:42.417595+0000","last_active":"2024-05-14T15:15:48.501523+0000","last_peered":"2024-05-14T15:15:48.501523+0000","last_clean":"2024-05-14T15:15:48.501523+0000","last_became_active":"2024-05-14T15:15:42.417179+0000","last_became_peered":"2024-05-14T15:15:42.417179+0000","last_unstale":"2024-05-14T15:15:48.501523+0000","last_undegraded":"2024-05-14T15:15:48.501523+0000","last_fullsized":"2024-05-14T15:15:48.501523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:42:18.787349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498176+0000","last_change":"2024-05-14T15:15:43.457677+0000","last_active":"2024-05-14T15:15:48.498176+0000","last_peered":"2024-05-14T15:15:48.498176+0000","last_clean":"2024-05-14T15:15:48.498176+0000","last_became_active":"2024-05-14T15:15:43.452767+0000","last_became_peered":"2024-05-14T15:15:43.452767+0000","last_unstale":"2024-05-14T15:15:48.498176+0000","last_undegraded":"2024-05-14T15:15:48.498176+0000","last_fullsized":"2024-05-14T15:15:48.498176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623643+0000","last_change":"2024-05-14T15:15:47.495167+0000","last_active":"2024-05-14T15:15:48.623643+0000","last_peered":"2024-05-14T15:15:48.623643+0000","last_clean":"2024-05-14T15:15:48.623643+0000","last_became_active":"2024-05-14T15:15:47.492518+0000","last_became_peered":"2024-05-14T15:15:47.492518+0000","last_unstale":"2024-05-14T15:15:48.623643+0000","last_undegraded":"2024-05-14T15:15:48.623643+0000","last_fullsized":"2024-05-14T15:15:48.623643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:50.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498369+0000","last_change":"2024-05-14T15:15:42.422083+0000","last_active":"2024-05-14T15:15:48.498369+0000","last_peered":"2024-05-14T15:15:48.498369+0000","last_clean":"2024-05-14T15:15:48.498369+0000","last_became_active":"2024-05-14T15:15:42.421028+0000","last_became_peered":"2024-05-14T15:15:42.421028+0000","last_unstale":"2024-05-14T15:15:48.498369+0000","last_undegraded":"2024-05-14T15:15:48.498369+0000","last_fullsized":"2024-05-14T15:15:48.498369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500289+0000","last_change":"2024-05-14T15:15:43.453241+0000","last_active":"2024-05-14T15:15:48.500289+0000","last_peered":"2024-05-14T15:15:48.500289+0000","last_clean":"2024-05-14T15:15:48.500289+0000","last_became_active":"2024-05-14T15:15:43.452842+0000","last_became_peered":"2024-05-14T15:15:43.452842+0000","last_unstale":"2024-05-14T15:15:48.500289+0000","last_undegraded":"2024-05-14T15:15:48.500289+0000","last_fullsized":"2024-05-14T15:15:48.500289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717215+0000","last_change":"2024-05-14T15:15:47.482168+0000","last_active":"2024-05-14T15:15:49.717215+0000","last_peered":"2024-05-14T15:15:49.717215+0000","last_clean":"2024-05-14T15:15:49.717215+0000","last_became_active":"2024-05-14T15:15:47.481660+0000","last_became_peered":"2024-05-14T15:15:47.481660+0000","last_unstale":"2024-05-14T15:15:49.717215+0000","last_undegraded":"2024-05-14T15:15:49.717215+0000","last_fullsized":"2024-05-14T15:15:49.717215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:55.796237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720865+0000","last_change":"2024-05-14T15:15:42.422851+0000","last_active":"2024-05-14T15:15:49.720865+0000","last_peered":"2024-05-14T15:15:49.720865+0000","last_clean":"2024-05-14T15:15:49.720865+0000","last_became_active":"2024-05-14T15:15:42.422311+0000","last_became_peered":"2024-05-14T15:15:42.422311+0000","last_unstale":"2024-05-14T15:15:49.720865+0000","last_undegraded":"2024-05-14T15:15:49.720865+0000","last_fullsized":"2024-05-14T15:15:49.720865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:08.447140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716843+0000","last_change":"2024-05-14T15:15:43.463138+0000","last_active":"2024-05-14T15:15:49.716843+0000","last_peered":"2024-05-14T15:15:49.716843+0000","last_clean":"2024-05-14T15:15:49.716843+0000","last_became_active":"2024-05-14T15:15:43.462013+0000","last_became_peered":"2024-05-14T15:15:43.462013+0000","last_unstale":"2024-05-14T15:15:49.716843+0000","last_undegraded":"2024-05-14T15:15:49.716843+0000","last_fullsized":"2024-05-14T15:15:49.716843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718047+0000","last_change":"2024-05-14T15:15:47.484138+0000","last_active":"2024-05-14T15:15:49.718047+0000","last_peered":"2024-05-14T15:15:49.718047+0000","last_clean":"2024-05-14T15:15:49.718047+0000","last_became_active":"2024-05-14T15:15:47.481944+0000","last_became_peered":"2024-05-14T15:15:47.481944+0000","last_unstale":"2024-05-14T15:15:49.718047+0000","last_undegraded":"2024-05-14T15:15:49.718047+0000","last_fullsized":"2024-05-14T15:15:49.718047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:46.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720875+0000","last_change":"2024-05-14T15:15:42.417373+0000","last_active":"2024-05-14T15:15:49.720875+0000","last_peered":"2024-05-14T15:15:49.720875+0000","last_clean":"2024-05-14T15:15:49.720875+0000","last_became_active":"2024-05-14T15:15:42.414048+0000","last_became_peered":"2024-05-14T15:15:42.414048+0000","last_unstale":"2024-05-14T15:15:49.720875+0000","last_undegraded":"2024-05-14T15:15:49.720875+0000","last_fullsized":"2024-05-14T15:15:49.720875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494888+0000","last_change":"2024-05-14T15:15:43.451769+0000","last_active":"2024-05-14T15:15:48.494888+0000","last_peered":"2024-05-14T15:15:48.494888+0000","last_clean":"2024-05-14T15:15:48.494888+0000","last_became_active":"2024-05-14T15:15:43.451412+0000","last_became_peered":"2024-05-14T15:15:43.451412+0000","last_unstale":"2024-05-14T15:15:48.494888+0000","last_undegraded":"2024-05-14T15:15:48.494888+0000","last_fullsized":"2024-05-14T15:15:48.494888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:49.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717130+0000","last_change":"2024-05-14T15:15:47.487605+0000","last_active":"2024-05-14T15:15:49.717130+0000","last_peered":"2024-05-14T15:15:49.717130+0000","last_clean":"2024-05-14T15:15:49.717130+0000","last_became_active":"2024-05-14T15:15:47.487161+0000","last_became_peered":"2024-05-14T15:15:47.487161+0000","last_unstale":"2024-05-14T15:15:49.717130+0000","last_undegraded":"2024-05-14T15:15:49.717130+0000","last_fullsized":"2024-05-14T15:15:49.717130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:53.249398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495256+0000","last_change":"2024-05-14T15:15:43.449347+0000","last_active":"2024-05-14T15:15:48.495256+0000","last_peered":"2024-05-14T15:15:48.495256+0000","last_clean":"2024-05-14T15:15:48.495256+0000","last_became_active":"2024-05-14T15:15:43.449033+0000","last_became_peered":"2024-05-14T15:15:43.449033+0000","last_unstale":"2024-05-14T15:15:48.495256+0000","last_undegraded":"2024-05-14T15:15:48.495256+0000","last_fullsized":"2024-05-14T15:15:48.495256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:38.435167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494527+0000","last_change":"2024-05-14T15:15:42.428357+0000","last_active":"2024-05-14T15:15:48.494527+0000","last_peered":"2024-05-14T15:15:48.494527+0000","last_clean":"2024-05-14T15:15:48.494527+0000","last_became_active":"2024-05-14T15:15:42.427991+0000","last_became_peered":"2024-05-14T15:15:42.427991+0000","last_unstale":"2024-05-14T15:15:48.494527+0000","last_undegraded":"2024-05-14T15:15:48.494527+0000","last_fullsized":"2024-05-14T15:15:48.494527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494376+0000","last_change":"2024-05-14T15:15:47.491521+0000","last_active":"2024-05-14T15:15:48.494376+0000","last_peered":"2024-05-14T15:15:48.494376+0000","last_clean":"2024-05-14T15:15:48.494376+0000","last_became_active":"2024-05-14T15:15:47.483066+0000","last_became_peered":"2024-05-14T15:15:47.483066+0000","last_unstale":"2024-05-14T15:15:48.494376+0000","last_undegraded":"2024-05-14T15:15:48.494376+0000","last_fullsized":"2024-05-14T15:15:48.494376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:50:18.051718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624028+0000","last_change":"2024-05-14T15:15:43.455362+0000","last_active":"2024-05-14T15:15:48.624028+0000","last_peered":"2024-05-14T15:15:48.624028+0000","last_clean":"2024-05-14T15:15:48.624028+0000","last_became_active":"2024-05-14T15:15:43.455028+0000","last_became_peered":"2024-05-14T15:15:43.455028+0000","last_unstale":"2024-05-14T15:15:48.624028+0000","last_undegraded":"2024-05-14T15:15:48.624028+0000","last_fullsized":"2024-05-14T15:15:48.624028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660478+0000","last_change":"2024-05-14T15:15:42.423694+0000","last_active":"2024-05-14T15:15:48.660478+0000","last_peered":"2024-05-14T15:15:48.660478+0000","last_clean":"2024-05-14T15:15:48.660478+0000","last_became_active":"2024-05-14T15:15:42.423346+0000","last_became_peered":"2024-05-14T15:15:42.423346+0000","last_unstale":"2024-05-14T15:15:48.660478+0000","last_undegraded":"2024-05-14T15:15:48.660478+0000","last_fullsized":"2024-05-14T15:15:48.660478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718485+0000","last_change":"2024-05-14T15:15:47.478026+0000","last_active":"2024-05-14T15:15:49.718485+0000","last_peered":"2024-05-14T15:15:49.718485+0000","last_clean":"2024-05-14T15:15:49.718485+0000","last_became_active":"2024-05-14T15:15:47.477418+0000","last_became_peered":"2024-05-14T15:15:47.477418+0000","last_unstale":"2024-05-14T15:15:49.718485+0000","last_undegraded":"2024-05-14T15:15:49.718485+0000","last_fullsized":"2024-05-14T15:15:49.718485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:13.853465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496213+0000","last_change":"2024-05-14T15:15:43.449813+0000","last_active":"2024-05-14T15:15:48.496213+0000","last_peered":"2024-05-14T15:15:48.496213+0000","last_clean":"2024-05-14T15:15:48.496213+0000","last_became_active":"2024-05-14T15:15:43.449491+0000","last_became_peered":"2024-05-14T15:15:43.449491+0000","last_unstale":"2024-05-14T15:15:48.496213+0000","last_undegraded":"2024-05-14T15:15:48.496213+0000","last_fullsized":"2024-05-14T15:15:48.496213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:27.960966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500467+0000","last_change":"2024-05-14T15:15:42.410105+0000","last_active":"2024-05-14T15:15:48.500467+0000","last_peered":"2024-05-14T15:15:48.500467+0000","last_clean":"2024-05-14T15:15:48.500467+0000","last_became_active":"2024-05-14T15:15:42.409688+0000","last_became_peered":"2024-05-14T15:15:42.409688+0000","last_unstale":"2024-05-14T15:15:48.500467+0000","last_undegraded":"2024-05-14T15:15:48.500467+0000","last_fullsized":"2024-05-14T15:15:48.500467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:49.012575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625612+0000","last_change":"2024-05-14T15:15:47.494744+0000","last_active":"2024-05-14T15:15:48.625612+0000","last_peered":"2024-05-14T15:15:48.625612+0000","last_clean":"2024-05-14T15:15:48.625612+0000","last_became_active":"2024-05-14T15:15:47.494270+0000","last_became_peered":"2024-05-14T15:15:47.494270+0000","last_unstale":"2024-05-14T15:15:48.625612+0000","last_undegraded":"2024-05-14T15:15:48.625612+0000","last_fullsized":"2024-05-14T15:15:48.625612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:51.834016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493342+0000","last_change":"2024-05-14T15:15:43.439361+0000","last_active":"2024-05-14T15:15:48.493342+0000","last_peered":"2024-05-14T15:15:48.493342+0000","last_clean":"2024-05-14T15:15:48.493342+0000","last_became_active":"2024-05-14T15:15:43.438756+0000","last_became_peered":"2024-05-14T15:15:43.438756+0000","last_unstale":"2024-05-14T15:15:48.493342+0000","last_undegraded":"2024-05-14T15:15:48.493342+0000","last_fullsized":"2024-05-14T15:15:48.493342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.714906+0000","last_change":"2024-05-14T15:15:42.425311+0000","last_active":"2024-05-14T15:15:49.714906+0000","last_peered":"2024-05-14T15:15:49.714906+0000","last_clean":"2024-05-14T15:15:49.714906+0000","last_became_active":"2024-05-14T15:15:42.424936+0000","last_became_peered":"2024-05-14T15:15:42.424936+0000","last_unstale":"2024-05-14T15:15:49.714906+0000","last_undegraded":"2024-05-14T15:15:49.714906+0000","last_fullsized":"2024-05-14T15:15:49.714906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718624+0000","last_change":"2024-05-14T15:15:47.491770+0000","last_active":"2024-05-14T15:15:49.718624+0000","last_peered":"2024-05-14T15:15:49.718624+0000","last_clean":"2024-05-14T15:15:49.718624+0000","last_became_active":"2024-05-14T15:15:47.491142+0000","last_became_peered":"2024-05-14T15:15:47.491142+0000","last_unstale":"2024-05-14T15:15:49.718624+0000","last_undegraded":"2024-05-14T15:15:49.718624+0000","last_fullsized":"2024-05-14T15:15:49.718624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501015+0000","last_change":"2024-05-14T15:15:43.451792+0000","last_active":"2024-05-14T15:15:48.501015+0000","last_peered":"2024-05-14T15:15:48.501015+0000","last_clean":"2024-05-14T15:15:48.501015+0000","last_became_active":"2024-05-14T15:15:43.451516+0000","last_became_peered":"2024-05-14T15:15:43.451516+0000","last_unstale":"2024-05-14T15:15:48.501015+0000","last_undegraded":"2024-05-14T15:15:48.501015+0000","last_fullsized":"2024-05-14T15:15:48.501015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:14:36.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496509+0000","last_change":"2024-05-14T15:15:42.428657+0000","last_active":"2024-05-14T15:15:48.496509+0000","last_peered":"2024-05-14T15:15:48.496509+0000","last_clean":"2024-05-14T15:15:48.496509+0000","last_became_active":"2024-05-14T15:15:42.428310+0000","last_became_peered":"2024-05-14T15:15:42.428310+0000","last_unstale":"2024-05-14T15:15:48.496509+0000","last_undegraded":"2024-05-14T15:15:48.496509+0000","last_fullsized":"2024-05-14T15:15:48.496509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:46.764246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718337+0000","last_change":"2024-05-14T15:15:47.477836+0000","last_active":"2024-05-14T15:15:49.718337+0000","last_peered":"2024-05-14T15:15:49.718337+0000","last_clean":"2024-05-14T15:15:49.718337+0000","last_became_active":"2024-05-14T15:15:47.477251+0000","last_became_peered":"2024-05-14T15:15:47.477251+0000","last_unstale":"2024-05-14T15:15:49.718337+0000","last_undegraded":"2024-05-14T15:15:49.718337+0000","last_fullsized":"2024-05-14T15:15:49.718337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501525+0000","last_change":"2024-05-14T15:15:43.448073+0000","last_active":"2024-05-14T15:15:48.501525+0000","last_peered":"2024-05-14T15:15:48.501525+0000","last_clean":"2024-05-14T15:15:48.501525+0000","last_became_active":"2024-05-14T15:15:43.447739+0000","last_became_peered":"2024-05-14T15:15:43.447739+0000","last_unstale":"2024-05-14T15:15:48.501525+0000","last_undegraded":"2024-05-14T15:15:48.501525+0000","last_fullsized":"2024-05-14T15:15:48.501525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:23:43.903273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501466+0000","last_change":"2024-05-14T15:15:42.427140+0000","last_active":"2024-05-14T15:15:48.501466+0000","last_peered":"2024-05-14T15:15:48.501466+0000","last_clean":"2024-05-14T15:15:48.501466+0000","last_became_active":"2024-05-14T15:15:42.426707+0000","last_became_peered":"2024-05-14T15:15:42.426707+0000","last_unstale":"2024-05-14T15:15:48.501466+0000","last_undegraded":"2024-05-14T15:15:48.501466+0000","last_fullsized":"2024-05-14T15:15:48.501466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:03:25.685366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496063+0000","last_change":"2024-05-14T15:15:47.483414+0000","last_active":"2024-05-14T15:15:48.496063+0000","last_peered":"2024-05-14T15:15:48.496063+0000","last_clean":"2024-05-14T15:15:48.496063+0000","last_became_active":"2024-05-14T15:15:47.481887+0000","last_became_peered":"2024-05-14T15:15:47.481887+0000","last_unstale":"2024-05-14T15:15:48.496063+0000","last_undegraded":"2024-05-14T15:15:48.496063+0000","last_fullsized":"2024-05-14T15:15:48.496063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:19.741676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661238+0000","last_change":"2024-05-14T15:15:43.446652+0000","last_active":"2024-05-14T15:15:48.661238+0000","last_peered":"2024-05-14T15:15:48.661238+0000","last_clean":"2024-05-14T15:15:48.661238+0000","last_became_active":"2024-05-14T15:15:43.446198+0000","last_became_peered":"2024-05-14T15:15:43.446198+0000","last_unstale":"2024-05-14T15:15:48.661238+0000","last_undegraded":"2024-05-14T15:15:48.661238+0000","last_fullsized":"2024-05-14T15:15:48.661238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:20.926603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495856+0000","last_change":"2024-05-14T15:15:42.414654+0000","last_active":"2024-05-14T15:15:48.495856+0000","last_peered":"2024-05-14T15:15:48.495856+0000","last_clean":"2024-05-14T15:15:48.495856+0000","last_became_active":"2024-05-14T15:15:42.413985+0000","last_became_peered":"2024-05-14T15:15:42.413985+0000","last_unstale":"2024-05-14T15:15:48.495856+0000","last_undegraded":"2024-05-14T15:15:48.495856+0000","last_fullsized":"2024-05-14T15:15:48.495856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660214+0000","last_change":"2024-05-14T15:15:47.492068+0000","last_active":"2024-05-14T15:15:48.660214+0000","last_peered":"2024-05-14T15:15:48.660214+0000","last_clean":"2024-05-14T15:15:48.660214+0000","last_became_active":"2024-05-14T15:15:47.490448+0000","last_became_peered":"2024-05-14T15:15:47.490448+0000","last_unstale":"2024-05-14T15:15:48.660214+0000","last_undegraded":"2024-05-14T15:15:48.660214+0000","last_fullsized":"2024-05-14T15:15:48.660214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717513+0000","last_change":"2024-05-14T15:15:43.451337+0000","last_active":"2024-05-14T15:15:49.717513+0000","last_peered":"2024-05-14T15:15:49.717513+0000","last_clean":"2024-05-14T15:15:49.717513+0000","last_became_active":"2024-05-14T15:15:43.450311+0000","last_became_peered":"2024-05-14T15:15:43.450311+0000","last_unstale":"2024-05-14T15:15:49.717513+0000","last_undegraded":"2024-05-14T15:15:49.717513+0000","last_fullsized":"2024-05-14T15:15:49.717513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496817+0000","last_change":"2024-05-14T15:15:42.421741+0000","last_active":"2024-05-14T15:15:48.496817+0000","last_peered":"2024-05-14T15:15:48.496817+0000","last_clean":"2024-05-14T15:15:48.496817+0000","last_became_active":"2024-05-14T15:15:42.421312+0000","last_became_peered":"2024-05-14T15:15:42.421312+0000","last_unstale":"2024-05-14T15:15:48.496817+0000","last_undegraded":"2024-05-14T15:15:48.496817+0000","last_fullsized":"2024-05-14T15:15:48.496817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659797+0000","last_change":"2024-05-14T15:15:47.490863+0000","last_active":"2024-05-14T15:15:48.659797+0000","last_peered":"2024-05-14T15:15:48.659797+0000","last_clean":"2024-05-14T15:15:48.659797+0000","last_became_active":"2024-05-14T15:15:47.486549+0000","last_became_peered":"2024-05-14T15:15:47.486549+0000","last_unstale":"2024-05-14T15:15:48.659797+0000","last_undegraded":"2024-05-14T15:15:48.659797+0000","last_fullsized":"2024-05-14T15:15:48.659797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717975+0000","last_change":"2024-05-14T15:15:43.465531+0000","last_active":"2024-05-14T15:15:49.717975+0000","last_peered":"2024-05-14T15:15:49.717975+0000","last_clean":"2024-05-14T15:15:49.717975+0000","last_became_active":"2024-05-14T15:15:43.464373+0000","last_became_peered":"2024-05-14T15:15:43.464373+0000","last_unstale":"2024-05-14T15:15:49.717975+0000","last_undegraded":"2024-05-14T15:15:49.717975+0000","last_fullsized":"2024-05-14T15:15:49.717975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494929+0000","last_change":"2024-05-14T15:15:42.418453+0000","last_active":"2024-05-14T15:15:48.494929+0000","last_peered":"2024-05-14T15:15:48.494929+0000","last_clean":"2024-05-14T15:15:48.494929+0000","last_became_active":"2024-05-14T15:15:42.418059+0000","last_became_peered":"2024-05-14T15:15:42.418059+0000","last_unstale":"2024-05-14T15:15:48.494929+0000","last_undegraded":"2024-05-14T15:15:48.494929+0000","last_fullsized":"2024-05-14T15:15:48.494929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:32.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661174+0000","last_change":"2024-05-14T15:15:47.481831+0000","last_active":"2024-05-14T15:15:48.661174+0000","last_peered":"2024-05-14T15:15:48.661174+0000","last_clean":"2024-05-14T15:15:48.661174+0000","last_became_active":"2024-05-14T15:15:47.481346+0000","last_became_peered":"2024-05-14T15:15:47.481346+0000","last_unstale":"2024-05-14T15:15:48.661174+0000","last_undegraded":"2024-05-14T15:15:48.661174+0000","last_fullsized":"2024-05-14T15:15:48.661174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:00.730977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495341+0000","last_change":"2024-05-14T15:15:43.467579+0000","last_active":"2024-05-14T15:15:48.495341+0000","last_peered":"2024-05-14T15:15:48.495341+0000","last_clean":"2024-05-14T15:15:48.495341+0000","last_became_active":"2024-05-14T15:15:43.454366+0000","last_became_peered":"2024-05-14T15:15:43.454366+0000","last_unstale":"2024-05-14T15:15:48.495341+0000","last_undegraded":"2024-05-14T15:15:48.495341+0000","last_fullsized":"2024-05-14T15:15:48.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624009+0000","last_change":"2024-05-14T15:15:42.420082+0000","last_active":"2024-05-14T15:15:48.624009+0000","last_peered":"2024-05-14T15:15:48.624009+0000","last_clean":"2024-05-14T15:15:48.624009+0000","last_became_active":"2024-05-14T15:15:42.418989+0000","last_became_peered":"2024-05-14T15:15:42.418989+0000","last_unstale":"2024-05-14T15:15:48.624009+0000","last_undegraded":"2024-05-14T15:15:48.624009+0000","last_fullsized":"2024-05-14T15:15:48.624009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660851+0000","last_change":"2024-05-14T15:15:47.486116+0000","last_active":"2024-05-14T15:15:48.660851+0000","last_peered":"2024-05-14T15:15:48.660851+0000","last_clean":"2024-05-14T15:15:48.660851+0000","last_became_active":"2024-05-14T15:15:47.485631+0000","last_became_peered":"2024-05-14T15:15:47.485631+0000","last_unstale":"2024-05-14T15:15:48.660851+0000","last_undegraded":"2024-05-14T15:15:48.660851+0000","last_fullsized":"2024-05-14T15:15:48.660851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:18.678917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659639+0000","last_change":"2024-05-14T15:15:43.457783+0000","last_active":"2024-05-14T15:15:48.659639+0000","last_peered":"2024-05-14T15:15:48.659639+0000","last_clean":"2024-05-14T15:15:48.659639+0000","last_became_active":"2024-05-14T15:15:43.457467+0000","last_became_peered":"2024-05-14T15:15:43.457467+0000","last_unstale":"2024-05-14T15:15:48.659639+0000","last_undegraded":"2024-05-14T15:15:48.659639+0000","last_fullsized":"2024-05-14T15:15:48.659639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:46.016672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493577+0000","last_change":"2024-05-14T15:15:42.420702+0000","last_active":"2024-05-14T15:15:48.493577+0000","last_peered":"2024-05-14T15:15:48.493577+0000","last_clean":"2024-05-14T15:15:48.493577+0000","last_became_active":"2024-05-14T15:15:42.420368+0000","last_became_peered":"2024-05-14T15:15:42.420368+0000","last_unstale":"2024-05-14T15:15:48.493577+0000","last_undegraded":"2024-05-14T15:15:48.493577+0000","last_fullsized":"2024-05-14T15:15:48.493577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:19.912181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497528+0000","last_change":"2024-05-14T15:15:47.494317+0000","last_active":"2024-05-14T15:15:48.497528+0000","last_peered":"2024-05-14T15:15:48.497528+0000","last_clean":"2024-05-14T15:15:48.497528+0000","last_became_active":"2024-05-14T15:15:47.493154+0000","last_became_peered":"2024-05-14T15:15:47.493154+0000","last_unstale":"2024-05-14T15:15:48.497528+0000","last_undegraded":"2024-05-14T15:15:48.497528+0000","last_fullsized":"2024-05-14T15:15:48.497528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:41.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498904+0000","last_change":"2024-05-14T15:15:43.443926+0000","last_active":"2024-05-14T15:15:48.498904+0000","last_peered":"2024-05-14T15:15:48.498904+0000","last_clean":"2024-05-14T15:15:48.498904+0000","last_became_active":"2024-05-14T15:15:43.443583+0000","last_became_peered":"2024-05-14T15:15:43.443583+0000","last_unstale":"2024-05-14T15:15:48.498904+0000","last_undegraded":"2024-05-14T15:15:48.498904+0000","last_fullsized":"2024-05-14T15:15:48.498904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:30.263461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494582+0000","last_change":"2024-05-14T15:15:42.425277+0000","last_active":"2024-05-14T15:15:48.494582+0000","last_peered":"2024-05-14T15:15:48.494582+0000","last_clean":"2024-05-14T15:15:48.494582+0000","last_became_active":"2024-05-14T15:15:42.424947+0000","last_became_peered":"2024-05-14T15:15:42.424947+0000","last_unstale":"2024-05-14T15:15:48.494582+0000","last_undegraded":"2024-05-14T15:15:48.494582+0000","last_fullsized":"2024-05-14T15:15:48.494582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716310+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:15:49.716310+0000","last_peered":"2024-05-14T15:15:49.716310+0000","last_clean":"2024-05-14T15:15:49.716310+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:15:49.716310+0000","last_undegraded":"2024-05-14T15:15:49.716310+0000","last_fullsized":"2024-05-14T15:15:49.716310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495545+0000","last_change":"2024-05-14T15:15:47.472173+0000","last_active":"2024-05-14T15:15:48.495545+0000","last_peered":"2024-05-14T15:15:48.495545+0000","last_clean":"2024-05-14T15:15:48.495545+0000","last_became_active":"2024-05-14T15:15:47.471697+0000","last_became_peered":"2024-05-14T15:15:47.471697+0000","last_unstale":"2024-05-14T15:15:48.495545+0000","last_undegraded":"2024-05-14T15:15:48.495545+0000","last_fullsized":"2024-05-14T15:15:48.495545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:52:45.119238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495230+0000","last_change":"2024-05-14T15:15:43.448608+0000","last_active":"2024-05-14T15:15:48.495230+0000","last_peered":"2024-05-14T15:15:48.495230+0000","last_clean":"2024-05-14T15:15:48.495230+0000","last_became_active":"2024-05-14T15:15:43.448235+0000","last_became_peered":"2024-05-14T15:15:43.448235+0000","last_unstale":"2024-05-14T15:15:48.495230+0000","last_undegraded":"2024-05-14T15:15:48.495230+0000","last_fullsized":"2024-05-14T15:15:48.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:00.533218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661459+0000","last_change":"2024-05-14T15:15:42.428026+0000","last_active":"2024-05-14T15:15:48.661459+0000","last_peered":"2024-05-14T15:15:48.661459+0000","last_clean":"2024-05-14T15:15:48.661459+0000","last_became_active":"2024-05-14T15:15:42.427537+0000","last_became_peered":"2024-05-14T15:15:42.427537+0000","last_unstale":"2024-05-14T15:15:48.661459+0000","last_undegraded":"2024-05-14T15:15:48.661459+0000","last_fullsized":"2024-05-14T15:15:48.661459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717385+0000","last_change":"2024-05-14T15:15:47.490170+0000","last_active":"2024-05-14T15:15:49.717385+0000","last_peered":"2024-05-14T15:15:49.717385+0000","last_clean":"2024-05-14T15:15:49.717385+0000","last_became_active":"2024-05-14T15:15:47.487824+0000","last_became_peered":"2024-05-14T15:15:47.487824+0000","last_unstale":"2024-05-14T15:15:49.717385+0000","last_undegraded":"2024-05-14T15:15:49.717385+0000","last_fullsized":"2024-05-14T15:15:49.717385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:49.464915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720510+0000","last_change":"2024-05-14T15:15:43.464058+0000","last_active":"2024-05-14T15:15:49.720510+0000","last_peered":"2024-05-14T15:15:49.720510+0000","last_clean":"2024-05-14T15:15:49.720510+0000","last_became_active":"2024-05-14T15:15:43.463701+0000","last_became_peered":"2024-05-14T15:15:43.463701+0000","last_unstale":"2024-05-14T15:15:49.720510+0000","last_undegraded":"2024-05-14T15:15:49.720510+0000","last_fullsized":"2024-05-14T15:15:49.720510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498005+0000","last_change":"2024-05-14T15:15:42.411298+0000","last_active":"2024-05-14T15:15:48.498005+0000","last_peered":"2024-05-14T15:15:48.498005+0000","last_clean":"2024-05-14T15:15:48.498005+0000","last_became_active":"2024-05-14T15:15:42.410793+0000","last_became_peered":"2024-05-14T15:15:42.410793+0000","last_unstale":"2024-05-14T15:15:48.498005+0000","last_undegraded":"2024-05-14T15:15:48.498005+0000","last_fullsized":"2024-05-14T15:15:48.498005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497076+0000","last_change":"2024-05-14T15:15:47.467300+0000","last_active":"2024-05-14T15:15:48.497076+0000","last_peered":"2024-05-14T15:15:48.497076+0000","last_clean":"2024-05-14T15:15:48.497076+0000","last_became_active":"2024-05-14T15:15:47.466741+0000","last_became_peered":"2024-05-14T15:15:47.466741+0000","last_unstale":"2024-05-14T15:15:48.497076+0000","last_undegraded":"2024-05-14T15:15:48.497076+0000","last_fullsized":"2024-05-14T15:15:48.497076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:53.743066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720754+0000","last_change":"2024-05-14T15:15:43.447908+0000","last_active":"2024-05-14T15:15:49.720754+0000","last_peered":"2024-05-14T15:15:49.720754+0000","last_clean":"2024-05-14T15:15:49.720754+0000","last_became_active":"2024-05-14T15:15:43.447571+0000","last_became_peered":"2024-05-14T15:15:43.447571+0000","last_unstale":"2024-05-14T15:15:49.720754+0000","last_undegraded":"2024-05-14T15:15:49.720754+0000","last_fullsized":"2024-05-14T15:15:49.720754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501459+0000","last_change":"2024-05-14T15:15:42.417527+0000","last_active":"2024-05-14T15:15:48.501459+0000","last_peered":"2024-05-14T15:15:48.501459+0000","last_clean":"2024-05-14T15:15:48.501459+0000","last_became_active":"2024-05-14T15:15:42.417147+0000","last_became_peered":"2024-05-14T15:15:42.417147+0000","last_unstale":"2024-05-14T15:15:48.501459+0000","last_undegraded":"2024-05-14T15:15:48.501459+0000","last_fullsized":"2024-05-14T15:15:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:56:23.532241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.492764+0000","last_change":"2024-05-14T15:15:47.474753+0000","last_active":"2024-05-14T15:15:48.492764+0000","last_peered":"2024-05-14T15:15:48.492764+0000","last_clean":"2024-05-14T15:15:48.492764+0000","last_became_active":"2024-05-14T15:15:47.471673+0000","last_became_peered":"2024-05-14T15:15:47.471673+0000","last_unstale":"2024-05-14T15:15:48.492764+0000","last_undegraded":"2024-05-14T15:15:48.492764+0000","last_fullsized":"2024-05-14T15:15:48.492764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:24:43.316754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718819+0000","last_change":"2024-05-14T15:15:43.466649+0000","last_active":"2024-05-14T15:15:49.718819+0000","last_peered":"2024-05-14T15:15:49.718819+0000","last_clean":"2024-05-14T15:15:49.718819+0000","last_became_active":"2024-05-14T15:15:43.466206+0000","last_became_peered":"2024-05-14T15:15:43.466206+0000","last_unstale":"2024-05-14T15:15:49.718819+0000","last_undegraded":"2024-05-14T15:15:49.718819+0000","last_fullsized":"2024-05-14T15:15:49.718819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720923+0000","last_change":"2024-05-14T15:15:42.423219+0000","last_active":"2024-05-14T15:15:49.720923+0000","last_peered":"2024-05-14T15:15:49.720923+0000","last_clean":"2024-05-14T15:15:49.720923+0000","last_became_active":"2024-05-14T15:15:42.419631+0000","last_became_peered":"2024-05-14T15:15:42.419631+0000","last_unstale":"2024-05-14T15:15:49.720923+0000","last_undegraded":"2024-05-14T15:15:49.720923+0000","last_fullsized":"2024-05-14T15:15:49.720923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715423+0000","last_change":"2024-05-14T15:15:47.467637+0000","last_active":"2024-05-14T15:15:49.715423+0000","last_peered":"2024-05-14T15:15:49.715423+0000","last_clean":"2024-05-14T15:15:49.715423+0000","last_became_active":"2024-05-14T15:15:47.467193+0000","last_became_peered":"2024-05-14T15:15:47.467193+0000","last_unstale":"2024-05-14T15:15:49.715423+0000","last_undegraded":"2024-05-14T15:15:49.715423+0000","last_fullsized":"2024-05-14T15:15:49.715423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:26.200001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493066+0000","last_change":"2024-05-14T15:15:43.452875+0000","last_active":"2024-05-14T15:15:48.493066+0000","last_peered":"2024-05-14T15:15:48.493066+0000","last_clean":"2024-05-14T15:15:48.493066+0000","last_became_active":"2024-05-14T15:15:43.451854+0000","last_became_peered":"2024-05-14T15:15:43.451854+0000","last_unstale":"2024-05-14T15:15:48.493066+0000","last_undegraded":"2024-05-14T15:15:48.493066+0000","last_fullsized":"2024-05-14T15:15:48.493066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:42.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496486+0000","last_change":"2024-05-14T15:15:42.415604+0000","last_active":"2024-05-14T15:15:48.496486+0000","last_peered":"2024-05-14T15:15:48.496486+0000","last_clean":"2024-05-14T15:15:48.496486+0000","last_became_active":"2024-05-14T15:15:42.415191+0000","last_became_peered":"2024-05-14T15:15:42.415191+0000","last_unstale":"2024-05-14T15:15:48.496486+0000","last_undegraded":"2024-05-14T15:15:48.496486+0000","last_fullsized":"2024-05-14T15:15:48.496486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:57:56.475764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498134+0000","last_change":"2024-05-14T15:15:47.479478+0000","last_active":"2024-05-14T15:15:48.498134+0000","last_peered":"2024-05-14T15:15:48.498134+0000","last_clean":"2024-05-14T15:15:48.498134+0000","last_became_active":"2024-05-14T15:15:47.479035+0000","last_became_peered":"2024-05-14T15:15:47.479035+0000","last_unstale":"2024-05-14T15:15:48.498134+0000","last_undegraded":"2024-05-14T15:15:48.498134+0000","last_fullsized":"2024-05-14T15:15:48.498134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:21.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716155+0000","last_change":"2024-05-14T15:15:43.428593+0000","last_active":"2024-05-14T15:15:49.716155+0000","last_peered":"2024-05-14T15:15:49.716155+0000","last_clean":"2024-05-14T15:15:49.716155+0000","last_became_active":"2024-05-14T15:15:43.427534+0000","last_became_peered":"2024-05-14T15:15:43.427534+0000","last_unstale":"2024-05-14T15:15:49.716155+0000","last_undegraded":"2024-05-14T15:15:49.716155+0000","last_fullsized":"2024-05-14T15:15:49.716155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715821+0000","last_change":"2024-05-14T15:15:42.422410+0000","last_active":"2024-05-14T15:15:49.715821+0000","last_peered":"2024-05-14T15:15:49.715821+0000","last_clean":"2024-05-14T15:15:49.715821+0000","last_became_active":"2024-05-14T15:15:42.422082+0000","last_became_peered":"2024-05-14T15:15:42.422082+0000","last_unstale":"2024-05-14T15:15:49.715821+0000","last_undegraded":"2024-05-14T15:15:49.715821+0000","last_fullsized":"2024-05-14T15:15:49.715821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500190+0000","last_change":"2024-05-14T15:15:47.484942+0000","last_active":"2024-05-14T15:15:48.500190+0000","last_peered":"2024-05-14T15:15:48.500190+0000","last_clean":"2024-05-14T15:15:48.500190+0000","last_became_active":"2024-05-14T15:15:47.484470+0000","last_became_peered":"2024-05-14T15:15:47.484470+0000","last_unstale":"2024-05-14T15:15:48.500190+0000","last_undegraded":"2024-05-14T15:15:48.500190+0000","last_fullsized":"2024-05-14T15:15:48.500190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:55:55.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494248+0000","last_change":"2024-05-14T15:15:43.453259+0000","last_active":"2024-05-14T15:15:48.494248+0000","last_peered":"2024-05-14T15:15:48.494248+0000","last_clean":"2024-05-14T15:15:48.494248+0000","last_became_active":"2024-05-14T15:15:43.452961+0000","last_became_peered":"2024-05-14T15:15:43.452961+0000","last_unstale":"2024-05-14T15:15:48.494248+0000","last_undegraded":"2024-05-14T15:15:48.494248+0000","last_fullsized":"2024-05-14T15:15:48.494248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:22.596094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494575+0000","last_change":"2024-05-14T15:15:42.421393+0000","last_active":"2024-05-14T15:15:48.494575+0000","last_peered":"2024-05-14T15:15:48.494575+0000","last_clean":"2024-05-14T15:15:48.494575+0000","last_became_active":"2024-05-14T15:15:42.420606+0000","last_became_peered":"2024-05-14T15:15:42.420606+0000","last_unstale":"2024-05-14T15:15:48.494575+0000","last_undegraded":"2024-05-14T15:15:48.494575+0000","last_fullsized":"2024-05-14T15:15:48.494575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:54.271748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660641+0000","last_change":"2024-05-14T15:15:47.487448+0000","last_active":"2024-05-14T15:15:48.660641+0000","last_peered":"2024-05-14T15:15:48.660641+0000","last_clean":"2024-05-14T15:15:48.660641+0000","last_became_active":"2024-05-14T15:15:47.487018+0000","last_became_peered":"2024-05-14T15:15:47.487018+0000","last_unstale":"2024-05-14T15:15:48.660641+0000","last_undegraded":"2024-05-14T15:15:48.660641+0000","last_fullsized":"2024-05-14T15:15:48.660641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:46.795075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660071+0000","last_change":"2024-05-14T15:15:43.471275+0000","last_active":"2024-05-14T15:15:48.660071+0000","last_peered":"2024-05-14T15:15:48.660071+0000","last_clean":"2024-05-14T15:15:48.660071+0000","last_became_active":"2024-05-14T15:15:43.469496+0000","last_became_peered":"2024-05-14T15:15:43.469496+0000","last_unstale":"2024-05-14T15:15:48.660071+0000","last_undegraded":"2024-05-14T15:15:48.660071+0000","last_fullsized":"2024-05-14T15:15:48.660071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624389+0000","last_change":"2024-05-14T15:15:42.427285+0000","last_active":"2024-05-14T15:15:48.624389+0000","last_peered":"2024-05-14T15:15:48.624389+0000","last_clean":"2024-05-14T15:15:48.624389+0000","last_became_active":"2024-05-14T15:15:42.426859+0000","last_became_peered":"2024-05-14T15:15:42.426859+0000","last_unstale":"2024-05-14T15:15:48.624389+0000","last_undegraded":"2024-05-14T15:15:48.624389+0000","last_fullsized":"2024-05-14T15:15:48.624389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495007+0000","last_change":"2024-05-14T15:15:47.490888+0000","last_active":"2024-05-14T15:15:48.495007+0000","last_peered":"2024-05-14T15:15:48.495007+0000","last_clean":"2024-05-14T15:15:48.495007+0000","last_became_active":"2024-05-14T15:15:47.482649+0000","last_became_peered":"2024-05-14T15:15:47.482649+0000","last_unstale":"2024-05-14T15:15:48.495007+0000","last_undegraded":"2024-05-14T15:15:48.495007+0000","last_fullsized":"2024-05-14T15:15:48.495007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:26.333915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720738+0000","last_change":"2024-05-14T15:15:43.452281+0000","last_active":"2024-05-14T15:15:49.720738+0000","last_peered":"2024-05-14T15:15:49.720738+0000","last_clean":"2024-05-14T15:15:49.720738+0000","last_became_active":"2024-05-14T15:15:43.446861+0000","last_became_peered":"2024-05-14T15:15:43.446861+0000","last_unstale":"2024-05-14T15:15:49.720738+0000","last_undegraded":"2024-05-14T15:15:49.720738+0000","last_fullsized":"2024-05-14T15:15:49.720738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:59.089651+0000","last_change":"2024-05-14T15:15:42.423989+0000","last_active":"2024-05-14T15:15:59.089651+0000","last_peered":"2024-05-14T15:15:59.089651+0000","last_clean":"2024-05-14T15:15:59.089651+0000","last_became_active":"2024-05-14T15:15:42.423577+0000","last_became_peered":"2024-05-14T15:15:42.423577+0000","last_unstale":"2024-05-14T15:15:59.089651+0000","last_undegraded":"2024-05-14T15:15:59.089651+0000","last_fullsized":"2024-05-14T15:15:59.089651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:04.149215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498558+0000","last_change":"2024-05-14T15:15:47.475619+0000","last_active":"2024-05-14T15:15:48.498558+0000","last_peered":"2024-05-14T15:15:48.498558+0000","last_clean":"2024-05-14T15:15:48.498558+0000","last_became_active":"2024-05-14T15:15:47.471644+0000","last_became_peered":"2024-05-14T15:15:47.471644+0000","last_unstale":"2024-05-14T15:15:48.498558+0000","last_undegraded":"2024-05-14T15:15:48.498558+0000","last_fullsized":"2024-05-14T15:15:48.498558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:20:14.327039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494104+0000","last_change":"2024-05-14T15:15:43.452445+0000","last_active":"2024-05-14T15:15:48.494104+0000","last_peered":"2024-05-14T15:15:48.494104+0000","last_clean":"2024-05-14T15:15:48.494104+0000","last_became_active":"2024-05-14T15:15:43.452110+0000","last_became_peered":"2024-05-14T15:15:43.452110+0000","last_unstale":"2024-05-14T15:15:48.494104+0000","last_undegraded":"2024-05-14T15:15:48.494104+0000","last_fullsized":"2024-05-14T15:15:48.494104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:58.112691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624967+0000","last_change":"2024-05-14T15:15:42.414691+0000","last_active":"2024-05-14T15:15:48.624967+0000","last_peered":"2024-05-14T15:15:48.624967+0000","last_clean":"2024-05-14T15:15:48.624967+0000","last_became_active":"2024-05-14T15:15:42.411431+0000","last_became_peered":"2024-05-14T15:15:42.411431+0000","last_unstale":"2024-05-14T15:15:48.624967+0000","last_undegraded":"2024-05-14T15:15:48.624967+0000","last_fullsized":"2024-05-14T15:15:48.624967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718327+0000","last_change":"2024-05-14T15:15:47.490431+0000","last_active":"2024-05-14T15:15:49.718327+0000","last_peered":"2024-05-14T15:15:49.718327+0000","last_clean":"2024-05-14T15:15:49.718327+0000","last_became_active":"2024-05-14T15:15:47.488871+0000","last_became_peered":"2024-05-14T15:15:47.488871+0000","last_unstale":"2024-05-14T15:15:49.718327+0000","last_undegraded":"2024-05-14T15:15:49.718327+0000","last_fullsized":"2024-05-14T15:15:49.718327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:36.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500537+0000","last_change":"2024-05-14T15:15:43.471432+0000","last_active":"2024-05-14T15:15:48.500537+0000","last_peered":"2024-05-14T15:15:48.500537+0000","last_clean":"2024-05-14T15:15:48.500537+0000","last_became_active":"2024-05-14T15:15:43.468506+0000","last_became_peered":"2024-05-14T15:15:43.468506+0000","last_unstale":"2024-05-14T15:15:48.500537+0000","last_undegraded":"2024-05-14T15:15:48.500537+0000","last_fullsized":"2024-05-14T15:15:48.500537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721397+0000","last_change":"2024-05-14T15:15:42.425352+0000","last_active":"2024-05-14T15:15:49.721397+0000","last_peered":"2024-05-14T15:15:49.721397+0000","last_clean":"2024-05-14T15:15:49.721397+0000","last_became_active":"2024-05-14T15:15:42.424788+0000","last_became_peered":"2024-05-14T15:15:42.424788+0000","last_unstale":"2024-05-14T15:15:49.721397+0000","last_undegraded":"2024-05-14T15:15:49.721397+0000","last_fullsized":"2024-05-14T15:15:49.721397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623638+0000","last_change":"2024-05-14T15:15:47.495775+0000","last_active":"2024-05-14T15:15:48.623638+0000","last_peered":"2024-05-14T15:15:48.623638+0000","last_clean":"2024-05-14T15:15:48.623638+0000","last_became_active":"2024-05-14T15:15:47.494949+0000","last_became_peered":"2024-05-14T15:15:47.494949+0000","last_unstale":"2024-05-14T15:15:48.623638+0000","last_undegraded":"2024-05-14T15:15:48.623638+0000","last_fullsized":"2024-05-14T15:15:48.623638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:24.981952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718767+0000","last_change":"2024-05-14T15:15:43.455269+0000","last_active":"2024-05-14T15:15:49.718767+0000","last_peered":"2024-05-14T15:15:49.718767+0000","last_clean":"2024-05-14T15:15:49.718767+0000","last_became_active":"2024-05-14T15:15:43.454902+0000","last_became_peered":"2024-05-14T15:15:43.454902+0000","last_unstale":"2024-05-14T15:15:49.718767+0000","last_undegraded":"2024-05-14T15:15:49.718767+0000","last_fullsized":"2024-05-14T15:15:49.718767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720229+0000","last_change":"2024-05-14T15:15:42.413462+0000","last_active":"2024-05-14T15:15:49.720229+0000","last_peered":"2024-05-14T15:15:49.720229+0000","last_clean":"2024-05-14T15:15:49.720229+0000","last_became_active":"2024-05-14T15:15:42.412838+0000","last_became_peered":"2024-05-14T15:15:42.412838+0000","last_unstale":"2024-05-14T15:15:49.720229+0000","last_undegraded":"2024-05-14T15:15:49.720229+0000","last_fullsized":"2024-05-14T15:15:49.720229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499953+0000","last_change":"2024-05-14T15:15:47.481470+0000","last_active":"2024-05-14T15:15:48.499953+0000","last_peered":"2024-05-14T15:15:48.499953+0000","last_clean":"2024-05-14T15:15:48.499953+0000","last_became_active":"2024-05-14T15:15:47.480935+0000","last_became_peered":"2024-05-14T15:15:47.480935+0000","last_unstale":"2024-05-14T15:15:48.499953+0000","last_undegraded":"2024-05-14T15:15:48.499953+0000","last_fullsized":"2024-05-14T15:15:48.499953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:27.398715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501300+0000","last_change":"2024-05-14T15:15:47.470190+0000","last_active":"2024-05-14T15:15:48.501300+0000","last_peered":"2024-05-14T15:15:48.501300+0000","last_clean":"2024-05-14T15:15:48.501300+0000","last_became_active":"2024-05-14T15:15:47.469486+0000","last_became_peered":"2024-05-14T15:15:47.469486+0000","last_unstale":"2024-05-14T15:15:48.501300+0000","last_undegraded":"2024-05-14T15:15:48.501300+0000","last_fullsized":"2024-05-14T15:15:48.501300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:02:29.447286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500142+0000","last_change":"2024-05-14T15:15:43.432186+0000","last_active":"2024-05-14T15:15:48.500142+0000","last_peered":"2024-05-14T15:15:48.500142+0000","last_clean":"2024-05-14T15:15:48.500142+0000","last_became_active":"2024-05-14T15:15:43.431075+0000","last_became_peered":"2024-05-14T15:15:43.431075+0000","last_unstale":"2024-05-14T15:15:48.500142+0000","last_undegraded":"2024-05-14T15:15:48.500142+0000","last_fullsized":"2024-05-14T15:15:48.500142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:57.608006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493573+0000","last_change":"2024-05-14T15:15:42.429681+0000","last_active":"2024-05-14T15:15:48.493573+0000","last_peered":"2024-05-14T15:15:48.493573+0000","last_clean":"2024-05-14T15:15:48.493573+0000","last_became_active":"2024-05-14T15:15:42.426654+0000","last_became_peered":"2024-05-14T15:15:42.426654+0000","last_unstale":"2024-05-14T15:15:48.493573+0000","last_undegraded":"2024-05-14T15:15:48.493573+0000","last_fullsized":"2024-05-14T15:15:48.493573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:21.130230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496123+0000","last_change":"2024-05-14T15:15:47.474072+0000","last_active":"2024-05-14T15:15:48.496123+0000","last_peered":"2024-05-14T15:15:48.496123+0000","last_clean":"2024-05-14T15:15:48.496123+0000","last_became_active":"2024-05-14T15:15:47.473621+0000","last_became_peered":"2024-05-14T15:15:47.473621+0000","last_unstale":"2024-05-14T15:15:48.496123+0000","last_undegraded":"2024-05-14T15:15:48.496123+0000","last_fullsized":"2024-05-14T15:15:48.496123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:49.410071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495656+0000","last_change":"2024-05-14T15:15:43.448709+0000","last_active":"2024-05-14T15:15:48.495656+0000","last_peered":"2024-05-14T15:15:48.495656+0000","last_clean":"2024-05-14T15:15:48.495656+0000","last_became_active":"2024-05-14T15:15:43.448068+0000","last_became_peered":"2024-05-14T15:15:43.448068+0000","last_unstale":"2024-05-14T15:15:48.495656+0000","last_undegraded":"2024-05-14T15:15:48.495656+0000","last_fullsized":"2024-05-14T15:15:48.495656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659737+0000","last_change":"2024-05-14T15:15:42.429751+0000","last_active":"2024-05-14T15:15:48.659737+0000","last_peered":"2024-05-14T15:15:48.659737+0000","last_clean":"2024-05-14T15:15:48.659737+0000","last_became_active":"2024-05-14T15:15:42.429380+0000","last_became_peered":"2024-05-14T15:15:42.429380+0000","last_unstale":"2024-05-14T15:15:48.659737+0000","last_undegraded":"2024-05-14T15:15:48.659737+0000","last_fullsized":"2024-05-14T15:15:48.659737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494212+0000","last_change":"2024-05-14T15:15:42.428978+0000","last_active":"2024-05-14T15:15:48.494212+0000","last_peered":"2024-05-14T15:15:48.494212+0000","last_clean":"2024-05-14T15:15:48.494212+0000","last_became_active":"2024-05-14T15:15:42.428627+0000","last_became_peered":"2024-05-14T15:15:42.428627+0000","last_unstale":"2024-05-14T15:15:48.494212+0000","last_undegraded":"2024-05-14T15:15:48.494212+0000","last_fullsized":"2024-05-14T15:15:48.494212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:05.667253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499610+0000","last_change":"2024-05-14T15:15:43.447982+0000","last_active":"2024-05-14T15:15:48.499610+0000","last_peered":"2024-05-14T15:15:48.499610+0000","last_clean":"2024-05-14T15:15:48.499610+0000","last_became_active":"2024-05-14T15:15:43.446590+0000","last_became_peered":"2024-05-14T15:15:43.446590+0000","last_unstale":"2024-05-14T15:15:48.499610+0000","last_undegraded":"2024-05-14T15:15:48.499610+0000","last_fullsized":"2024-05-14T15:15:48.499610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:05.808230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499664+0000","last_change":"2024-05-14T15:15:47.488195+0000","last_active":"2024-05-14T15:15:48.499664+0000","last_peered":"2024-05-14T15:15:48.499664+0000","last_clean":"2024-05-14T15:15:48.499664+0000","last_became_active":"2024-05-14T15:15:47.487122+0000","last_became_peered":"2024-05-14T15:15:47.487122+0000","last_unstale":"2024-05-14T15:15:48.499664+0000","last_undegraded":"2024-05-14T15:15:48.499664+0000","last_fullsized":"2024-05-14T15:15:48.499664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:10:11.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499154+0000","last_change":"2024-05-14T15:15:42.420415+0000","last_active":"2024-05-14T15:15:48.499154+0000","last_peered":"2024-05-14T15:15:48.499154+0000","last_clean":"2024-05-14T15:15:48.499154+0000","last_became_active":"2024-05-14T15:15:42.420023+0000","last_became_peered":"2024-05-14T15:15:42.420023+0000","last_unstale":"2024-05-14T15:15:48.499154+0000","last_undegraded":"2024-05-14T15:15:48.499154+0000","last_fullsized":"2024-05-14T15:15:48.499154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717100+0000","last_change":"2024-05-14T15:15:43.442403+0000","last_active":"2024-05-14T15:15:49.717100+0000","last_peered":"2024-05-14T15:15:49.717100+0000","last_clean":"2024-05-14T15:15:49.717100+0000","last_became_active":"2024-05-14T15:15:43.442018+0000","last_became_peered":"2024-05-14T15:15:43.442018+0000","last_unstale":"2024-05-14T15:15:49.717100+0000","last_undegraded":"2024-05-14T15:15:49.717100+0000","last_fullsized":"2024-05-14T15:15:49.717100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624856+0000","last_change":"2024-05-14T15:15:47.484476+0000","last_active":"2024-05-14T15:15:48.624856+0000","last_peered":"2024-05-14T15:15:48.624856+0000","last_clean":"2024-05-14T15:15:48.624856+0000","last_became_active":"2024-05-14T15:15:47.483990+0000","last_became_peered":"2024-05-14T15:15:47.483990+0000","last_unstale":"2024-05-14T15:15:48.624856+0000","last_undegraded":"2024-05-14T15:15:48.624856+0000","last_fullsized":"2024-05-14T15:15:48.624856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:44.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717437+0000","last_change":"2024-05-14T15:15:43.452753+0000","last_active":"2024-05-14T15:15:49.717437+0000","last_peered":"2024-05-14T15:15:49.717437+0000","last_clean":"2024-05-14T15:15:49.717437+0000","last_became_active":"2024-05-14T15:15:43.450752+0000","last_became_peered":"2024-05-14T15:15:43.450752+0000","last_unstale":"2024-05-14T15:15:49.717437+0000","last_undegraded":"2024-05-14T15:15:49.717437+0000","last_fullsized":"2024-05-14T15:15:49.717437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623679+0000","last_change":"2024-05-14T15:15:43.459094+0000","last_active":"2024-05-14T15:15:48.623679+0000","last_peered":"2024-05-14T15:15:48.623679+0000","last_clean":"2024-05-14T15:15:48.623679+0000","last_became_active":"2024-05-14T15:15:43.458723+0000","last_became_peered":"2024-05-14T15:15:43.458723+0000","last_unstale":"2024-05-14T15:15:48.623679+0000","last_undegraded":"2024-05-14T15:15:48.623679+0000","last_fullsized":"2024-05-14T15:15:48.623679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493568+0000","last_change":"2024-05-14T15:15:43.446191+0000","last_active":"2024-05-14T15:15:48.493568+0000","last_peered":"2024-05-14T15:15:48.493568+0000","last_clean":"2024-05-14T15:15:48.493568+0000","last_became_active":"2024-05-14T15:15:43.445883+0000","last_became_peered":"2024-05-14T15:15:43.445883+0000","last_unstale":"2024-05-14T15:15:48.493568+0000","last_undegraded":"2024-05-14T15:15:48.493568+0000","last_fullsized":"2024-05-14T15:15:48.493568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:09.798116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497390+0000","last_change":"2024-05-14T15:15:43.462772+0000","last_active":"2024-05-14T15:15:48.497390+0000","last_peered":"2024-05-14T15:15:48.497390+0000","last_clean":"2024-05-14T15:15:48.497390+0000","last_became_active":"2024-05-14T15:15:43.458133+0000","last_became_peered":"2024-05-14T15:15:43.458133+0000","last_unstale":"2024-05-14T15:15:48.497390+0000","last_undegraded":"2024-05-14T15:15:48.497390+0000","last_fullsized":"2024-05-14T15:15:48.497390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660954+0000","last_change":"2024-05-14T15:15:43.464641+0000","last_active":"2024-05-14T15:15:48.660954+0000","last_peered":"2024-05-14T15:15:48.660954+0000","last_clean":"2024-05-14T15:15:48.660954+0000","last_became_active":"2024-05-14T15:15:43.464263+0000","last_became_peered":"2024-05-14T15:15:43.464263+0000","last_unstale":"2024-05-14T15:15:48.660954+0000","last_undegraded":"2024-05-14T15:15:48.660954+0000","last_fullsized":"2024-05-14T15:15:48.660954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660941+0000","last_change":"2024-05-14T15:15:43.453266+0000","last_active":"2024-05-14T15:15:48.660941+0000","last_peered":"2024-05-14T15:15:48.660941+0000","last_clean":"2024-05-14T15:15:48.660941+0000","last_became_active":"2024-05-14T15:15:43.452641+0000","last_became_peered":"2024-05-14T15:15:43.452641+0000","last_unstale":"2024-05-14T15:15:48.660941+0000","last_undegraded":"2024-05-14T15:15:48.660941+0000","last_fullsized":"2024-05-14T15:15:48.660941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:22.144652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718639+0000","last_change":"2024-05-14T15:15:43.455928+0000","last_active":"2024-05-14T15:15:49.718639+0000","last_peered":"2024-05-14T15:15:49.718639+0000","last_clean":"2024-05-14T15:15:49.718639+0000","last_became_active":"2024-05-14T15:15:43.454949+0000","last_became_peered":"2024-05-14T15:15:43.454949+0000","last_unstale":"2024-05-14T15:15:49.718639+0000","last_undegraded":"2024-05-14T15:15:49.718639+0000","last_fullsized":"2024-05-14T15:15:49.718639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499982+0000","last_change":"2024-05-14T15:15:43.470552+0000","last_active":"2024-05-14T15:15:48.499982+0000","last_peered":"2024-05-14T15:15:48.499982+0000","last_clean":"2024-05-14T15:15:48.499982+0000","last_became_active":"2024-05-14T15:15:43.453144+0000","last_became_peered":"2024-05-14T15:15:43.453144+0000","last_unstale":"2024-05-14T15:15:48.499982+0000","last_undegraded":"2024-05-14T15:15:48.499982+0000","last_fullsized":"2024-05-14T15:15:48.499982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493251+0000","last_change":"2024-05-14T15:15:43.442622+0000","last_active":"2024-05-14T15:15:48.493251+0000","last_peered":"2024-05-14T15:15:48.493251+0000","last_clean":"2024-05-14T15:15:48.493251+0000","last_became_active":"2024-05-14T15:15:43.442296+0000","last_became_peered":"2024-05-14T15:15:43.442296+0000","last_unstale":"2024-05-14T15:15:48.493251+0000","last_undegraded":"2024-05-14T15:15:48.493251+0000","last_fullsized":"2024-05-14T15:15:48.493251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496080+0000","last_change":"2024-05-14T15:15:43.447439+0000","last_active":"2024-05-14T15:15:48.496080+0000","last_peered":"2024-05-14T15:15:48.496080+0000","last_clean":"2024-05-14T15:15:48.496080+0000","last_became_active":"2024-05-14T15:15:43.446137+0000","last_became_peered":"2024-05-14T15:15:43.446137+0000","last_unstale":"2024-05-14T15:15:48.496080+0000","last_undegraded":"2024-05-14T15:15:48.496080+0000","last_fullsized":"2024-05-14T15:15:48.496080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716730+0000","last_change":"2024-05-14T15:15:43.449082+0000","last_active":"2024-05-14T15:15:49.716730+0000","last_peered":"2024-05-14T15:15:49.716730+0000","last_clean":"2024-05-14T15:15:49.716730+0000","last_became_active":"2024-05-14T15:15:43.446819+0000","last_became_peered":"2024-05-14T15:15:43.446819+0000","last_unstale":"2024-05-14T15:15:49.716730+0000","last_undegraded":"2024-05-14T15:15:49.716730+0000","last_fullsized":"2024-05-14T15:15:49.716730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499241+0000","last_change":"2024-05-14T15:15:43.447350+0000","last_active":"2024-05-14T15:15:48.499241+0000","last_peered":"2024-05-14T15:15:48.499241+0000","last_clean":"2024-05-14T15:15:48.499241+0000","last_became_active":"2024-05-14T15:15:43.445520+0000","last_became_peered":"2024-05-14T15:15:43.445520+0000","last_unstale":"2024-05-14T15:15:48.499241+0000","last_undegraded":"2024-05-14T15:15:48.499241+0000","last_fullsized":"2024-05-14T15:15:48.499241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:59:26.779034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720137+0000","last_change":"2024-05-14T15:15:43.455780+0000","last_active":"2024-05-14T15:15:49.720137+0000","last_peered":"2024-05-14T15:15:49.720137+0000","last_clean":"2024-05-14T15:15:49.720137+0000","last_became_active":"2024-05-14T15:15:43.450530+0000","last_became_peered":"2024-05-14T15:15:43.450530+0000","last_unstale":"2024-05-14T15:15:49.720137+0000","last_undegraded":"2024-05-14T15:15:49.720137+0000","last_fullsized":"2024-05-14T15:15:49.720137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495537+0000","last_change":"2024-05-14T15:15:43.444694+0000","last_active":"2024-05-14T15:15:48.495537+0000","last_peered":"2024-05-14T15:15:48.495537+0000","last_clean":"2024-05-14T15:15:48.495537+0000","last_became_active":"2024-05-14T15:15:43.444051+0000","last_became_peered":"2024-05-14T15:15:43.444051+0000","last_unstale":"2024-05-14T15:15:48.495537+0000","last_undegraded":"2024-05-14T15:15:48.495537+0000","last_fullsized":"2024-05-14T15:15:48.495537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:37.310772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625143+0000","last_change":"2024-05-14T15:15:43.460795+0000","last_active":"2024-05-14T15:15:48.625143+0000","last_peered":"2024-05-14T15:15:48.625143+0000","last_clean":"2024-05-14T15:15:48.625143+0000","last_became_active":"2024-05-14T15:15:43.460482+0000","last_became_peered":"2024-05-14T15:15:43.460482+0000","last_unstale":"2024-05-14T15:15:48.625143+0000","last_undegraded":"2024-05-14T15:15:48.625143+0000","last_fullsized":"2024-05-14T15:15:48.625143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496414+0000","last_change":"2024-05-14T15:15:43.454445+0000","last_active":"2024-05-14T15:15:48.496414+0000","last_peered":"2024-05-14T15:15:48.496414+0000","last_clean":"2024-05-14T15:15:48.496414+0000","last_became_active":"2024-05-14T15:15:43.453963+0000","last_became_peered":"2024-05-14T15:15:43.453963+0000","last_unstale":"2024-05-14T15:15:48.496414+0000","last_undegraded":"2024-05-14T15:15:48.496414+0000","last_fullsized":"2024-05-14T15:15:48.496414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:17.114782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493224+0000","last_change":"2024-05-14T15:15:43.451680+0000","last_active":"2024-05-14T15:15:48.493224+0000","last_peered":"2024-05-14T15:15:48.493224+0000","last_clean":"2024-05-14T15:15:48.493224+0000","last_became_active":"2024-05-14T15:15:43.451213+0000","last_became_peered":"2024-05-14T15:15:43.451213+0000","last_unstale":"2024-05-14T15:15:48.493224+0000","last_undegraded":"2024-05-14T15:15:48.493224+0000","last_fullsized":"2024-05-14T15:15:48.493224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495636+0000","last_change":"2024-05-14T15:15:43.450048+0000","last_active":"2024-05-14T15:15:48.495636+0000","last_peered":"2024-05-14T15:15:48.495636+0000","last_clean":"2024-05-14T15:15:48.495636+0000","last_became_active":"2024-05-14T15:15:43.447077+0000","last_became_peered":"2024-05-14T15:15:43.447077+0000","last_unstale":"2024-05-14T15:15:48.495636+0000","last_undegraded":"2024-05-14T15:15:48.495636+0000","last_fullsized":"2024-05-14T15:15:48.495636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:44.172442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659777+0000","last_change":"2024-05-14T15:15:43.452199+0000","last_active":"2024-05-14T15:15:48.659777+0000","last_peered":"2024-05-14T15:15:48.659777+0000","last_clean":"2024-05-14T15:15:48.659777+0000","last_became_active":"2024-05-14T15:15:43.451112+0000","last_became_peered":"2024-05-14T15:15:43.451112+0000","last_unstale":"2024-05-14T15:15:48.659777+0000","last_undegraded":"2024-05-14T15:15:48.659777+0000","last_fullsized":"2024-05-14T15:15:48.659777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660603+0000","last_change":"2024-05-14T15:15:43.467060+0000","last_active":"2024-05-14T15:15:48.660603+0000","last_peered":"2024-05-14T15:15:48.660603+0000","last_clean":"2024-05-14T15:15:48.660603+0000","last_became_active":"2024-05-14T15:15:43.466622+0000","last_became_peered":"2024-05-14T15:15:43.466622+0000","last_unstale":"2024-05-14T15:15:48.660603+0000","last_undegraded":"2024-05-14T15:15:48.660603+0000","last_fullsized":"2024-05-14T15:15:48.660603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:40.234140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.719694+0000","last_change":"2024-05-14T15:15:43.457250+0000","last_active":"2024-05-14T15:15:49.719694+0000","last_peered":"2024-05-14T15:15:49.719694+0000","last_clean":"2024-05-14T15:15:49.719694+0000","last_became_active":"2024-05-14T15:15:43.456942+0000","last_became_peered":"2024-05-14T15:15:43.456942+0000","last_unstale":"2024-05-14T15:15:49.719694+0000","last_undegraded":"2024-05-14T15:15:49.719694+0000","last_fullsized":"2024-05-14T15:15:49.719694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720574+0000","last_change":"2024-05-14T15:15:43.457388+0000","last_active":"2024-05-14T15:15:49.720574+0000","last_peered":"2024-05-14T15:15:49.720574+0000","last_clean":"2024-05-14T15:15:49.720574+0000","last_became_active":"2024-05-14T15:15:43.457024+0000","last_became_peered":"2024-05-14T15:15:43.457024+0000","last_unstale":"2024-05-14T15:15:49.720574+0000","last_undegraded":"2024-05-14T15:15:49.720574+0000","last_fullsized":"2024-05-14T15:15:49.720574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721313+0000","last_change":"2024-05-14T15:15:43.455894+0000","last_active":"2024-05-14T15:15:49.721313+0000","last_peered":"2024-05-14T15:15:49.721313+0000","last_clean":"2024-05-14T15:15:49.721313+0000","last_became_active":"2024-05-14T15:15:43.455558+0000","last_became_peered":"2024-05-14T15:15:43.455558+0000","last_unstale":"2024-05-14T15:15:49.721313+0000","last_undegraded":"2024-05-14T15:15:49.721313+0000","last_fullsized":"2024-05-14T15:15:49.721313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720231+0000","last_change":"2024-05-14T15:15:43.466235+0000","last_active":"2024-05-14T15:15:49.720231+0000","last_peered":"2024-05-14T15:15:49.720231+0000","last_clean":"2024-05-14T15:15:49.720231+0000","last_became_active":"2024-05-14T15:15:43.465681+0000","last_became_peered":"2024-05-14T15:15:43.465681+0000","last_unstale":"2024-05-14T15:15:49.720231+0000","last_undegraded":"2024-05-14T15:15:49.720231+0000","last_fullsized":"2024-05-14T15:15:49.720231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496181+0000","last_change":"2024-05-14T15:15:43.450897+0000","last_active":"2024-05-14T15:15:48.496181+0000","last_peered":"2024-05-14T15:15:48.496181+0000","last_clean":"2024-05-14T15:15:48.496181+0000","last_became_active":"2024-05-14T15:15:43.450206+0000","last_became_peered":"2024-05-14T15:15:43.450206+0000","last_unstale":"2024-05-14T15:15:48.496181+0000","last_undegraded":"2024-05-14T15:15:48.496181+0000","last_fullsized":"2024-05-14T15:15:48.496181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715857+0000","last_change":"2024-05-14T15:15:43.456409+0000","last_active":"2024-05-14T15:15:49.715857+0000","last_peered":"2024-05-14T15:15:49.715857+0000","last_clean":"2024-05-14T15:15:49.715857+0000","last_became_active":"2024-05-14T15:15:43.448064+0000","last_became_peered":"2024-05-14T15:15:43.448064+0000","last_unstale":"2024-05-14T15:15:49.715857+0000","last_undegraded":"2024-05-14T15:15:49.715857+0000","last_fullsized":"2024-05-14T15:15:49.715857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717628+0000","last_change":"2024-05-14T15:15:43.448505+0000","last_active":"2024-05-14T15:15:49.717628+0000","last_peered":"2024-05-14T15:15:49.717628+0000","last_clean":"2024-05-14T15:15:49.717628+0000","last_became_active":"2024-05-14T15:15:43.448130+0000","last_became_peered":"2024-05-14T15:15:43.448130+0000","last_unstale":"2024-05-14T15:15:49.717628+0000","last_undegraded":"2024-05-14T15:15:49.717628+0000","last_fullsized":"2024-05-14T15:15:49.717628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717789+0000","last_change":"2024-05-14T15:15:43.441410+0000","last_active":"2024-05-14T15:15:49.717789+0000","last_peered":"2024-05-14T15:15:49.717789+0000","last_clean":"2024-05-14T15:15:49.717789+0000","last_became_active":"2024-05-14T15:15:43.440720+0000","last_became_peered":"2024-05-14T15:15:43.440720+0000","last_unstale":"2024-05-14T15:15:49.717789+0000","last_undegraded":"2024-05-14T15:15:49.717789+0000","last_fullsized":"2024-05-14T15:15:49.717789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717624+0000","last_change":"2024-05-14T15:15:43.449956+0000","last_active":"2024-05-14T15:15:49.717624+0000","last_peered":"2024-05-14T15:15:49.717624+0000","last_clean":"2024-05-14T15:15:49.717624+0000","last_became_active":"2024-05-14T15:15:43.449153+0000","last_became_peered":"2024-05-14T15:15:43.449153+0000","last_unstale":"2024-05-14T15:15:49.717624+0000","last_undegraded":"2024-05-14T15:15:49.717624+0000","last_fullsized":"2024-05-14T15:15:49.717624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497578+0000","last_change":"2024-05-14T15:15:43.431817+0000","last_active":"2024-05-14T15:15:48.497578+0000","last_peered":"2024-05-14T15:15:48.497578+0000","last_clean":"2024-05-14T15:15:48.497578+0000","last_became_active":"2024-05-14T15:15:43.431329+0000","last_became_peered":"2024-05-14T15:15:43.431329+0000","last_unstale":"2024-05-14T15:15:48.497578+0000","last_undegraded":"2024-05-14T15:15:48.497578+0000","last_fullsized":"2024-05-14T15:15:48.497578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497862+0000","last_change":"2024-05-14T15:15:43.453311+0000","last_active":"2024-05-14T15:15:48.497862+0000","last_peered":"2024-05-14T15:15:48.497862+0000","last_clean":"2024-05-14T15:15:48.497862+0000","last_became_active":"2024-05-14T15:15:43.449852+0000","last_became_peered":"2024-05-14T15:15:43.449852+0000","last_unstale":"2024-05-14T15:15:48.497862+0000","last_undegraded":"2024-05-14T15:15:48.497862+0000","last_fullsized":"2024-05-14T15:15:48.497862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720694+0000","last_change":"2024-05-14T15:15:43.468567+0000","last_active":"2024-05-14T15:15:49.720694+0000","last_peered":"2024-05-14T15:15:49.720694+0000","last_clean":"2024-05-14T15:15:49.720694+0000","last_became_active":"2024-05-14T15:15:43.468239+0000","last_became_peered":"2024-05-14T15:15:43.468239+0000","last_unstale":"2024-05-14T15:15:49.720694+0000","last_undegraded":"2024-05-14T15:15:49.720694+0000","last_fullsized":"2024-05-14T15:15:49.720694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":109456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":110128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:16:16.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:16:17.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.201+0000 7fb6dfe00640 1 Processor -- start 2024-05-14T15:16:17.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.201+0000 7fb6dfe00640 1 -- start start 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.203+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006d700 0x7fb6e006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.203+0000 7fb6dfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6e00af130 0x7fb6e00af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.203+0000 7fb6dfe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e006e050 con 0x7fb6e006fbd0 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.203+0000 7fb6dfe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e006f180 con 0x7fb6e00af130 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.203+0000 7fb6dfe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0164590 con 0x7fb6e006d700 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.203+0000 7fb6df400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6e00af130 0x7fb6e00af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6df400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6e00af130 0x7fb6e00af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58968/0 (socket says 172.21.15.2:58968) 2024-05-14T15:16:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6df400640 1 -- 172.21.15.2:0/2422909382 learned_addr learned my addr 172.21.15.2:0/2422909382 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6d6000640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006d700 0x7fb6e006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6df400640 1 -- 172.21.15.2:0/2422909382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006d700 msgr2=0x7fb6e006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6df400640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006d700 0x7fb6e006db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6df400640 1 -- 172.21.15.2:0/2422909382 >> v1:172.21.15.2:6789/0 conn(0x7fb6e006fbd0 legacy=0x7fb6e0163af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6df400640 1 -- 172.21.15.2:0/2422909382 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e0164870 con 0x7fb6e00af130 2024-05-14T15:16:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.204+0000 7fb6d6000640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006d700 0x7fb6e006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:17.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.205+0000 7fb6df400640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e00af130 0x7fb6e00af540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009e50 tx=0x7fb6d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee7e3bf18954266 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.205+0000 7fb6de000640 1 -- 172.21.15.2:0/2422909382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8036070 con 0x7fb6e00af130 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.205+0000 7fb6de000640 1 -- 172.21.15.2:0/2422909382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d8031600 con 0x7fb6e00af130 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.205+0000 7fb6de000640 1 -- 172.21.15.2:0/2422909382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80319d0 con 0x7fb6e00af130 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2422909382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e00af130 msgr2=0x7fb6e00af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e00af130 0x7fb6e00af540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009e50 tx=0x7fb6d802a680 comp rx=0 tx=0).stop 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2422909382 shutdown_connections 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e00af130 0x7fb6e00af540 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2422909382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006d700 0x7fb6e006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2422909382 >> 172.21.15.2:0/2422909382 conn(0x7fb6e00732e0 msgr2=0x7fb6e00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2422909382 shutdown_connections 2024-05-14T15:16:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.206+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2422909382 wait complete. 2024-05-14T15:16:17.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.209+0000 7fb6dfe00640 1 Processor -- start 2024-05-14T15:16:17.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.209+0000 7fb6dfe00640 1 -- start start 2024-05-14T15:16:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.210+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 0x7fb6e015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.210+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006fbd0 0x7fb6e0162a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.210+0000 7fb6dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00af130 0x7fb6e015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.210+0000 7fb6dfe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0070f20 con 0x7fb6e006d700 2024-05-14T15:16:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.210+0000 7fb6dfe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e006f6b0 con 0x7fb6e00af130 2024-05-14T15:16:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.210+0000 7fb6dfe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0164200 con 0x7fb6e006fbd0 2024-05-14T15:16:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 0x7fb6e015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 0x7fb6e015da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58976/0 (socket says 172.21.15.2:58976) 2024-05-14T15:16:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 -- 172.21.15.2:0/2335875084 learned_addr learned my addr 172.21.15.2:0/2335875084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6d6000640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006fbd0 0x7fb6e0162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6df400640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00af130 0x7fb6e015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 -- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006fbd0 msgr2=0x7fb6e0162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006fbd0 0x7fb6e0162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 -- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00af130 msgr2=0x7fb6e015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00af130 0x7fb6e015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 -- 172.21.15.2:0/2335875084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e01620c0 con 0x7fb6e006d700 2024-05-14T15:16:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6d6000640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006fbd0 0x7fb6e0162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6df400640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00af130 0x7fb6e015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.211+0000 7fb6dea00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 0x7fb6e015da00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c370 tx=0x7fb6d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.212+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0017070 con 0x7fb6e006d700 2024-05-14T15:16:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.212+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d00052d0 con 0x7fb6e006d700 2024-05-14T15:16:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.212+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0003830 con 0x7fb6e006d700 2024-05-14T15:16:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.212+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e015df40 con 0x7fb6e006d700 2024-05-14T15:16:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.212+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e01f9dc0 con 0x7fb6e006d700 2024-05-14T15:16:17.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.213+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e0050870 con 0x7fb6e006d700 2024-05-14T15:16:17.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.214+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6d001a070 con 0x7fb6e006d700 2024-05-14T15:16:17.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.215+0000 7fb6d7400640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6bc0762d0 0x7fb6bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.216+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb6d0096c40 con 0x7fb6e006d700 2024-05-14T15:16:17.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.216+0000 7fb6d6000640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6bc0762d0 0x7fb6bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.217+0000 7fb6d6000640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6bc0762d0 0x7fb6bc0787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8006fd0 tx=0x7fb6c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:17.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.220+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6e006e050 con 0x7fb6e006d700 2024-05-14T15:16:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.416+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6e0163860 con 0x7fb6bc0762d0 2024-05-14T15:16:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.441+0000 7fb6d7400640 1 -- 172.21.15.2:0/2335875084 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7fb6e0163860 con 0x7fb6bc0762d0 2024-05-14T15:16:17.445 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:17.447 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:16:17.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6bc0762d0 msgr2=0x7fb6bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6bc0762d0 0x7fb6bc0787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8006fd0 tx=0x7fb6c8008040 comp rx=0 tx=0).stop 2024-05-14T15:16:17.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 msgr2=0x7fb6e015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 0x7fb6e015da00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c370 tx=0x7fb6d000c830 comp rx=0 tx=0).stop 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 shutdown_connections 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6bc0762d0 0x7fb6bc0787e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00af130 0x7fb6e015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e006fbd0 0x7fb6e0162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 --2- 172.21.15.2:0/2335875084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6e006d700 0x7fb6e015da00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 >> 172.21.15.2:0/2335875084 conn(0x7fb6e00732e0 msgr2=0x7fb6e015e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 shutdown_connections 2024-05-14T15:16:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.446+0000 7fb6dfe00640 1 -- 172.21.15.2:0/2335875084 wait complete. 2024-05-14T15:16:17.468 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-14T15:16:16.857088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":150,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244476,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730244,"statfs":{"total":773094113280,"available":772843769856,"internally_reserved":0,"allocated":3416064,"data_stored":2034928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":246795828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006339"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501523+0000","last_change":"2024-05-14T15:15:42.417595+0000","last_active":"2024-05-14T15:15:48.501523+0000","last_peered":"2024-05-14T15:15:48.501523+0000","last_clean":"2024-05-14T15:15:48.501523+0000","last_became_active":"2024-05-14T15:15:42.417179+0000","last_became_peered":"2024-05-14T15:15:42.417179+0000","last_unstale":"2024-05-14T15:15:48.501523+0000","last_undegraded":"2024-05-14T15:15:48.501523+0000","last_fullsized":"2024-05-14T15:15:48.501523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:42:18.787349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498176+0000","last_change":"2024-05-14T15:15:43.457677+0000","last_active":"2024-05-14T15:15:48.498176+0000","last_peered":"2024-05-14T15:15:48.498176+0000","last_clean":"2024-05-14T15:15:48.498176+0000","last_became_active":"2024-05-14T15:15:43.452767+0000","last_became_peered":"2024-05-14T15:15:43.452767+0000","last_unstale":"2024-05-14T15:15:48.498176+0000","last_undegraded":"2024-05-14T15:15:48.498176+0000","last_fullsized":"2024-05-14T15:15:48.498176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623643+0000","last_change":"2024-05-14T15:15:47.495167+0000","last_active":"2024-05-14T15:15:48.623643+0000","last_peered":"2024-05-14T15:15:48.623643+0000","last_clean":"2024-05-14T15:15:48.623643+0000","last_became_active":"2024-05-14T15:15:47.492518+0000","last_became_peered":"2024-05-14T15:15:47.492518+0000","last_unstale":"2024-05-14T15:15:48.623643+0000","last_undegraded":"2024-05-14T15:15:48.623643+0000","last_fullsized":"2024-05-14T15:15:48.623643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:50.072020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498369+0000","last_change":"2024-05-14T15:15:42.422083+0000","last_active":"2024-05-14T15:15:48.498369+0000","last_peered":"2024-05-14T15:15:48.498369+0000","last_clean":"2024-05-14T15:15:48.498369+0000","last_became_active":"2024-05-14T15:15:42.421028+0000","last_became_peered":"2024-05-14T15:15:42.421028+0000","last_unstale":"2024-05-14T15:15:48.498369+0000","last_undegraded":"2024-05-14T15:15:48.498369+0000","last_fullsized":"2024-05-14T15:15:48.498369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500289+0000","last_change":"2024-05-14T15:15:43.453241+0000","last_active":"2024-05-14T15:15:48.500289+0000","last_peered":"2024-05-14T15:15:48.500289+0000","last_clean":"2024-05-14T15:15:48.500289+0000","last_became_active":"2024-05-14T15:15:43.452842+0000","last_became_peered":"2024-05-14T15:15:43.452842+0000","last_unstale":"2024-05-14T15:15:48.500289+0000","last_undegraded":"2024-05-14T15:15:48.500289+0000","last_fullsized":"2024-05-14T15:15:48.500289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717215+0000","last_change":"2024-05-14T15:15:47.482168+0000","last_active":"2024-05-14T15:15:49.717215+0000","last_peered":"2024-05-14T15:15:49.717215+0000","last_clean":"2024-05-14T15:15:49.717215+0000","last_became_active":"2024-05-14T15:15:47.481660+0000","last_became_peered":"2024-05-14T15:15:47.481660+0000","last_unstale":"2024-05-14T15:15:49.717215+0000","last_undegraded":"2024-05-14T15:15:49.717215+0000","last_fullsized":"2024-05-14T15:15:49.717215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:55.796237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720865+0000","last_change":"2024-05-14T15:15:42.422851+0000","last_active":"2024-05-14T15:15:49.720865+0000","last_peered":"2024-05-14T15:15:49.720865+0000","last_clean":"2024-05-14T15:15:49.720865+0000","last_became_active":"2024-05-14T15:15:42.422311+0000","last_became_peered":"2024-05-14T15:15:42.422311+0000","last_unstale":"2024-05-14T15:15:49.720865+0000","last_undegraded":"2024-05-14T15:15:49.720865+0000","last_fullsized":"2024-05-14T15:15:49.720865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:08.447140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716843+0000","last_change":"2024-05-14T15:15:43.463138+0000","last_active":"2024-05-14T15:15:49.716843+0000","last_peered":"2024-05-14T15:15:49.716843+0000","last_clean":"2024-05-14T15:15:49.716843+0000","last_became_active":"2024-05-14T15:15:43.462013+0000","last_became_peered":"2024-05-14T15:15:43.462013+0000","last_unstale":"2024-05-14T15:15:49.716843+0000","last_undegraded":"2024-05-14T15:15:49.716843+0000","last_fullsized":"2024-05-14T15:15:49.716843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718047+0000","last_change":"2024-05-14T15:15:47.484138+0000","last_active":"2024-05-14T15:15:49.718047+0000","last_peered":"2024-05-14T15:15:49.718047+0000","last_clean":"2024-05-14T15:15:49.718047+0000","last_became_active":"2024-05-14T15:15:47.481944+0000","last_became_peered":"2024-05-14T15:15:47.481944+0000","last_unstale":"2024-05-14T15:15:49.718047+0000","last_undegraded":"2024-05-14T15:15:49.718047+0000","last_fullsized":"2024-05-14T15:15:49.718047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:46.545089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720875+0000","last_change":"2024-05-14T15:15:42.417373+0000","last_active":"2024-05-14T15:15:49.720875+0000","last_peered":"2024-05-14T15:15:49.720875+0000","last_clean":"2024-05-14T15:15:49.720875+0000","last_became_active":"2024-05-14T15:15:42.414048+0000","last_became_peered":"2024-05-14T15:15:42.414048+0000","last_unstale":"2024-05-14T15:15:49.720875+0000","last_undegraded":"2024-05-14T15:15:49.720875+0000","last_fullsized":"2024-05-14T15:15:49.720875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494888+0000","last_change":"2024-05-14T15:15:43.451769+0000","last_active":"2024-05-14T15:15:48.494888+0000","last_peered":"2024-05-14T15:15:48.494888+0000","last_clean":"2024-05-14T15:15:48.494888+0000","last_became_active":"2024-05-14T15:15:43.451412+0000","last_became_peered":"2024-05-14T15:15:43.451412+0000","last_unstale":"2024-05-14T15:15:48.494888+0000","last_undegraded":"2024-05-14T15:15:48.494888+0000","last_fullsized":"2024-05-14T15:15:48.494888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:49.687718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717130+0000","last_change":"2024-05-14T15:15:47.487605+0000","last_active":"2024-05-14T15:15:49.717130+0000","last_peered":"2024-05-14T15:15:49.717130+0000","last_clean":"2024-05-14T15:15:49.717130+0000","last_became_active":"2024-05-14T15:15:47.487161+0000","last_became_peered":"2024-05-14T15:15:47.487161+0000","last_unstale":"2024-05-14T15:15:49.717130+0000","last_undegraded":"2024-05-14T15:15:49.717130+0000","last_fullsized":"2024-05-14T15:15:49.717130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:53.249398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495256+0000","last_change":"2024-05-14T15:15:43.449347+0000","last_active":"2024-05-14T15:15:48.495256+0000","last_peered":"2024-05-14T15:15:48.495256+0000","last_clean":"2024-05-14T15:15:48.495256+0000","last_became_active":"2024-05-14T15:15:43.449033+0000","last_became_peered":"2024-05-14T15:15:43.449033+0000","last_unstale":"2024-05-14T15:15:48.495256+0000","last_undegraded":"2024-05-14T15:15:48.495256+0000","last_fullsized":"2024-05-14T15:15:48.495256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:38.435167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494527+0000","last_change":"2024-05-14T15:15:42.428357+0000","last_active":"2024-05-14T15:15:48.494527+0000","last_peered":"2024-05-14T15:15:48.494527+0000","last_clean":"2024-05-14T15:15:48.494527+0000","last_became_active":"2024-05-14T15:15:42.427991+0000","last_became_peered":"2024-05-14T15:15:42.427991+0000","last_unstale":"2024-05-14T15:15:48.494527+0000","last_undegraded":"2024-05-14T15:15:48.494527+0000","last_fullsized":"2024-05-14T15:15:48.494527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494376+0000","last_change":"2024-05-14T15:15:47.491521+0000","last_active":"2024-05-14T15:15:48.494376+0000","last_peered":"2024-05-14T15:15:48.494376+0000","last_clean":"2024-05-14T15:15:48.494376+0000","last_became_active":"2024-05-14T15:15:47.483066+0000","last_became_peered":"2024-05-14T15:15:47.483066+0000","last_unstale":"2024-05-14T15:15:48.494376+0000","last_undegraded":"2024-05-14T15:15:48.494376+0000","last_fullsized":"2024-05-14T15:15:48.494376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:50:18.051718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624028+0000","last_change":"2024-05-14T15:15:43.455362+0000","last_active":"2024-05-14T15:15:48.624028+0000","last_peered":"2024-05-14T15:15:48.624028+0000","last_clean":"2024-05-14T15:15:48.624028+0000","last_became_active":"2024-05-14T15:15:43.455028+0000","last_became_peered":"2024-05-14T15:15:43.455028+0000","last_unstale":"2024-05-14T15:15:48.624028+0000","last_undegraded":"2024-05-14T15:15:48.624028+0000","last_fullsized":"2024-05-14T15:15:48.624028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660478+0000","last_change":"2024-05-14T15:15:42.423694+0000","last_active":"2024-05-14T15:15:48.660478+0000","last_peered":"2024-05-14T15:15:48.660478+0000","last_clean":"2024-05-14T15:15:48.660478+0000","last_became_active":"2024-05-14T15:15:42.423346+0000","last_became_peered":"2024-05-14T15:15:42.423346+0000","last_unstale":"2024-05-14T15:15:48.660478+0000","last_undegraded":"2024-05-14T15:15:48.660478+0000","last_fullsized":"2024-05-14T15:15:48.660478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718485+0000","last_change":"2024-05-14T15:15:47.478026+0000","last_active":"2024-05-14T15:15:49.718485+0000","last_peered":"2024-05-14T15:15:49.718485+0000","last_clean":"2024-05-14T15:15:49.718485+0000","last_became_active":"2024-05-14T15:15:47.477418+0000","last_became_peered":"2024-05-14T15:15:47.477418+0000","last_unstale":"2024-05-14T15:15:49.718485+0000","last_undegraded":"2024-05-14T15:15:49.718485+0000","last_fullsized":"2024-05-14T15:15:49.718485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:13.853465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496213+0000","last_change":"2024-05-14T15:15:43.449813+0000","last_active":"2024-05-14T15:15:48.496213+0000","last_peered":"2024-05-14T15:15:48.496213+0000","last_clean":"2024-05-14T15:15:48.496213+0000","last_became_active":"2024-05-14T15:15:43.449491+0000","last_became_peered":"2024-05-14T15:15:43.449491+0000","last_unstale":"2024-05-14T15:15:48.496213+0000","last_undegraded":"2024-05-14T15:15:48.496213+0000","last_fullsized":"2024-05-14T15:15:48.496213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:27.960966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500467+0000","last_change":"2024-05-14T15:15:42.410105+0000","last_active":"2024-05-14T15:15:48.500467+0000","last_peered":"2024-05-14T15:15:48.500467+0000","last_clean":"2024-05-14T15:15:48.500467+0000","last_became_active":"2024-05-14T15:15:42.409688+0000","last_became_peered":"2024-05-14T15:15:42.409688+0000","last_unstale":"2024-05-14T15:15:48.500467+0000","last_undegraded":"2024-05-14T15:15:48.500467+0000","last_fullsized":"2024-05-14T15:15:48.500467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:49.012575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625612+0000","last_change":"2024-05-14T15:15:47.494744+0000","last_active":"2024-05-14T15:15:48.625612+0000","last_peered":"2024-05-14T15:15:48.625612+0000","last_clean":"2024-05-14T15:15:48.625612+0000","last_became_active":"2024-05-14T15:15:47.494270+0000","last_became_peered":"2024-05-14T15:15:47.494270+0000","last_unstale":"2024-05-14T15:15:48.625612+0000","last_undegraded":"2024-05-14T15:15:48.625612+0000","last_fullsized":"2024-05-14T15:15:48.625612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:51.834016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493342+0000","last_change":"2024-05-14T15:15:43.439361+0000","last_active":"2024-05-14T15:15:48.493342+0000","last_peered":"2024-05-14T15:15:48.493342+0000","last_clean":"2024-05-14T15:15:48.493342+0000","last_became_active":"2024-05-14T15:15:43.438756+0000","last_became_peered":"2024-05-14T15:15:43.438756+0000","last_unstale":"2024-05-14T15:15:48.493342+0000","last_undegraded":"2024-05-14T15:15:48.493342+0000","last_fullsized":"2024-05-14T15:15:48.493342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.714906+0000","last_change":"2024-05-14T15:15:42.425311+0000","last_active":"2024-05-14T15:15:49.714906+0000","last_peered":"2024-05-14T15:15:49.714906+0000","last_clean":"2024-05-14T15:15:49.714906+0000","last_became_active":"2024-05-14T15:15:42.424936+0000","last_became_peered":"2024-05-14T15:15:42.424936+0000","last_unstale":"2024-05-14T15:15:49.714906+0000","last_undegraded":"2024-05-14T15:15:49.714906+0000","last_fullsized":"2024-05-14T15:15:49.714906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:55:21.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718624+0000","last_change":"2024-05-14T15:15:47.491770+0000","last_active":"2024-05-14T15:15:49.718624+0000","last_peered":"2024-05-14T15:15:49.718624+0000","last_clean":"2024-05-14T15:15:49.718624+0000","last_became_active":"2024-05-14T15:15:47.491142+0000","last_became_peered":"2024-05-14T15:15:47.491142+0000","last_unstale":"2024-05-14T15:15:49.718624+0000","last_undegraded":"2024-05-14T15:15:49.718624+0000","last_fullsized":"2024-05-14T15:15:49.718624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501015+0000","last_change":"2024-05-14T15:15:43.451792+0000","last_active":"2024-05-14T15:15:48.501015+0000","last_peered":"2024-05-14T15:15:48.501015+0000","last_clean":"2024-05-14T15:15:48.501015+0000","last_became_active":"2024-05-14T15:15:43.451516+0000","last_became_peered":"2024-05-14T15:15:43.451516+0000","last_unstale":"2024-05-14T15:15:48.501015+0000","last_undegraded":"2024-05-14T15:15:48.501015+0000","last_fullsized":"2024-05-14T15:15:48.501015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:14:36.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496509+0000","last_change":"2024-05-14T15:15:42.428657+0000","last_active":"2024-05-14T15:15:48.496509+0000","last_peered":"2024-05-14T15:15:48.496509+0000","last_clean":"2024-05-14T15:15:48.496509+0000","last_became_active":"2024-05-14T15:15:42.428310+0000","last_became_peered":"2024-05-14T15:15:42.428310+0000","last_unstale":"2024-05-14T15:15:48.496509+0000","last_undegraded":"2024-05-14T15:15:48.496509+0000","last_fullsized":"2024-05-14T15:15:48.496509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:46.764246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718337+0000","last_change":"2024-05-14T15:15:47.477836+0000","last_active":"2024-05-14T15:15:49.718337+0000","last_peered":"2024-05-14T15:15:49.718337+0000","last_clean":"2024-05-14T15:15:49.718337+0000","last_became_active":"2024-05-14T15:15:47.477251+0000","last_became_peered":"2024-05-14T15:15:47.477251+0000","last_unstale":"2024-05-14T15:15:49.718337+0000","last_undegraded":"2024-05-14T15:15:49.718337+0000","last_fullsized":"2024-05-14T15:15:49.718337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501525+0000","last_change":"2024-05-14T15:15:43.448073+0000","last_active":"2024-05-14T15:15:48.501525+0000","last_peered":"2024-05-14T15:15:48.501525+0000","last_clean":"2024-05-14T15:15:48.501525+0000","last_became_active":"2024-05-14T15:15:43.447739+0000","last_became_peered":"2024-05-14T15:15:43.447739+0000","last_unstale":"2024-05-14T15:15:48.501525+0000","last_undegraded":"2024-05-14T15:15:48.501525+0000","last_fullsized":"2024-05-14T15:15:48.501525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:23:43.903273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501466+0000","last_change":"2024-05-14T15:15:42.427140+0000","last_active":"2024-05-14T15:15:48.501466+0000","last_peered":"2024-05-14T15:15:48.501466+0000","last_clean":"2024-05-14T15:15:48.501466+0000","last_became_active":"2024-05-14T15:15:42.426707+0000","last_became_peered":"2024-05-14T15:15:42.426707+0000","last_unstale":"2024-05-14T15:15:48.501466+0000","last_undegraded":"2024-05-14T15:15:48.501466+0000","last_fullsized":"2024-05-14T15:15:48.501466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:03:25.685366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496063+0000","last_change":"2024-05-14T15:15:47.483414+0000","last_active":"2024-05-14T15:15:48.496063+0000","last_peered":"2024-05-14T15:15:48.496063+0000","last_clean":"2024-05-14T15:15:48.496063+0000","last_became_active":"2024-05-14T15:15:47.481887+0000","last_became_peered":"2024-05-14T15:15:47.481887+0000","last_unstale":"2024-05-14T15:15:48.496063+0000","last_undegraded":"2024-05-14T15:15:48.496063+0000","last_fullsized":"2024-05-14T15:15:48.496063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:19.741676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661238+0000","last_change":"2024-05-14T15:15:43.446652+0000","last_active":"2024-05-14T15:15:48.661238+0000","last_peered":"2024-05-14T15:15:48.661238+0000","last_clean":"2024-05-14T15:15:48.661238+0000","last_became_active":"2024-05-14T15:15:43.446198+0000","last_became_peered":"2024-05-14T15:15:43.446198+0000","last_unstale":"2024-05-14T15:15:48.661238+0000","last_undegraded":"2024-05-14T15:15:48.661238+0000","last_fullsized":"2024-05-14T15:15:48.661238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:20.926603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495856+0000","last_change":"2024-05-14T15:15:42.414654+0000","last_active":"2024-05-14T15:15:48.495856+0000","last_peered":"2024-05-14T15:15:48.495856+0000","last_clean":"2024-05-14T15:15:48.495856+0000","last_became_active":"2024-05-14T15:15:42.413985+0000","last_became_peered":"2024-05-14T15:15:42.413985+0000","last_unstale":"2024-05-14T15:15:48.495856+0000","last_undegraded":"2024-05-14T15:15:48.495856+0000","last_fullsized":"2024-05-14T15:15:48.495856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660214+0000","last_change":"2024-05-14T15:15:47.492068+0000","last_active":"2024-05-14T15:15:48.660214+0000","last_peered":"2024-05-14T15:15:48.660214+0000","last_clean":"2024-05-14T15:15:48.660214+0000","last_became_active":"2024-05-14T15:15:47.490448+0000","last_became_peered":"2024-05-14T15:15:47.490448+0000","last_unstale":"2024-05-14T15:15:48.660214+0000","last_undegraded":"2024-05-14T15:15:48.660214+0000","last_fullsized":"2024-05-14T15:15:48.660214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:07.285517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717513+0000","last_change":"2024-05-14T15:15:43.451337+0000","last_active":"2024-05-14T15:15:49.717513+0000","last_peered":"2024-05-14T15:15:49.717513+0000","last_clean":"2024-05-14T15:15:49.717513+0000","last_became_active":"2024-05-14T15:15:43.450311+0000","last_became_peered":"2024-05-14T15:15:43.450311+0000","last_unstale":"2024-05-14T15:15:49.717513+0000","last_undegraded":"2024-05-14T15:15:49.717513+0000","last_fullsized":"2024-05-14T15:15:49.717513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496817+0000","last_change":"2024-05-14T15:15:42.421741+0000","last_active":"2024-05-14T15:15:48.496817+0000","last_peered":"2024-05-14T15:15:48.496817+0000","last_clean":"2024-05-14T15:15:48.496817+0000","last_became_active":"2024-05-14T15:15:42.421312+0000","last_became_peered":"2024-05-14T15:15:42.421312+0000","last_unstale":"2024-05-14T15:15:48.496817+0000","last_undegraded":"2024-05-14T15:15:48.496817+0000","last_fullsized":"2024-05-14T15:15:48.496817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:54.477984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659797+0000","last_change":"2024-05-14T15:15:47.490863+0000","last_active":"2024-05-14T15:15:48.659797+0000","last_peered":"2024-05-14T15:15:48.659797+0000","last_clean":"2024-05-14T15:15:48.659797+0000","last_became_active":"2024-05-14T15:15:47.486549+0000","last_became_peered":"2024-05-14T15:15:47.486549+0000","last_unstale":"2024-05-14T15:15:48.659797+0000","last_undegraded":"2024-05-14T15:15:48.659797+0000","last_fullsized":"2024-05-14T15:15:48.659797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:55.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717975+0000","last_change":"2024-05-14T15:15:43.465531+0000","last_active":"2024-05-14T15:15:49.717975+0000","last_peered":"2024-05-14T15:15:49.717975+0000","last_clean":"2024-05-14T15:15:49.717975+0000","last_became_active":"2024-05-14T15:15:43.464373+0000","last_became_peered":"2024-05-14T15:15:43.464373+0000","last_unstale":"2024-05-14T15:15:49.717975+0000","last_undegraded":"2024-05-14T15:15:49.717975+0000","last_fullsized":"2024-05-14T15:15:49.717975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494929+0000","last_change":"2024-05-14T15:15:42.418453+0000","last_active":"2024-05-14T15:15:48.494929+0000","last_peered":"2024-05-14T15:15:48.494929+0000","last_clean":"2024-05-14T15:15:48.494929+0000","last_became_active":"2024-05-14T15:15:42.418059+0000","last_became_peered":"2024-05-14T15:15:42.418059+0000","last_unstale":"2024-05-14T15:15:48.494929+0000","last_undegraded":"2024-05-14T15:15:48.494929+0000","last_fullsized":"2024-05-14T15:15:48.494929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:32.874558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661174+0000","last_change":"2024-05-14T15:15:47.481831+0000","last_active":"2024-05-14T15:15:48.661174+0000","last_peered":"2024-05-14T15:15:48.661174+0000","last_clean":"2024-05-14T15:15:48.661174+0000","last_became_active":"2024-05-14T15:15:47.481346+0000","last_became_peered":"2024-05-14T15:15:47.481346+0000","last_unstale":"2024-05-14T15:15:48.661174+0000","last_undegraded":"2024-05-14T15:15:48.661174+0000","last_fullsized":"2024-05-14T15:15:48.661174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:27:00.730977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495341+0000","last_change":"2024-05-14T15:15:43.467579+0000","last_active":"2024-05-14T15:15:48.495341+0000","last_peered":"2024-05-14T15:15:48.495341+0000","last_clean":"2024-05-14T15:15:48.495341+0000","last_became_active":"2024-05-14T15:15:43.454366+0000","last_became_peered":"2024-05-14T15:15:43.454366+0000","last_unstale":"2024-05-14T15:15:48.495341+0000","last_undegraded":"2024-05-14T15:15:48.495341+0000","last_fullsized":"2024-05-14T15:15:48.495341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624009+0000","last_change":"2024-05-14T15:15:42.420082+0000","last_active":"2024-05-14T15:15:48.624009+0000","last_peered":"2024-05-14T15:15:48.624009+0000","last_clean":"2024-05-14T15:15:48.624009+0000","last_became_active":"2024-05-14T15:15:42.418989+0000","last_became_peered":"2024-05-14T15:15:42.418989+0000","last_unstale":"2024-05-14T15:15:48.624009+0000","last_undegraded":"2024-05-14T15:15:48.624009+0000","last_fullsized":"2024-05-14T15:15:48.624009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660851+0000","last_change":"2024-05-14T15:15:47.486116+0000","last_active":"2024-05-14T15:15:48.660851+0000","last_peered":"2024-05-14T15:15:48.660851+0000","last_clean":"2024-05-14T15:15:48.660851+0000","last_became_active":"2024-05-14T15:15:47.485631+0000","last_became_peered":"2024-05-14T15:15:47.485631+0000","last_unstale":"2024-05-14T15:15:48.660851+0000","last_undegraded":"2024-05-14T15:15:48.660851+0000","last_fullsized":"2024-05-14T15:15:48.660851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:18.678917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659639+0000","last_change":"2024-05-14T15:15:43.457783+0000","last_active":"2024-05-14T15:15:48.659639+0000","last_peered":"2024-05-14T15:15:48.659639+0000","last_clean":"2024-05-14T15:15:48.659639+0000","last_became_active":"2024-05-14T15:15:43.457467+0000","last_became_peered":"2024-05-14T15:15:43.457467+0000","last_unstale":"2024-05-14T15:15:48.659639+0000","last_undegraded":"2024-05-14T15:15:48.659639+0000","last_fullsized":"2024-05-14T15:15:48.659639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:46.016672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493577+0000","last_change":"2024-05-14T15:15:42.420702+0000","last_active":"2024-05-14T15:15:48.493577+0000","last_peered":"2024-05-14T15:15:48.493577+0000","last_clean":"2024-05-14T15:15:48.493577+0000","last_became_active":"2024-05-14T15:15:42.420368+0000","last_became_peered":"2024-05-14T15:15:42.420368+0000","last_unstale":"2024-05-14T15:15:48.493577+0000","last_undegraded":"2024-05-14T15:15:48.493577+0000","last_fullsized":"2024-05-14T15:15:48.493577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:19.912181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497528+0000","last_change":"2024-05-14T15:15:47.494317+0000","last_active":"2024-05-14T15:15:48.497528+0000","last_peered":"2024-05-14T15:15:48.497528+0000","last_clean":"2024-05-14T15:15:48.497528+0000","last_became_active":"2024-05-14T15:15:47.493154+0000","last_became_peered":"2024-05-14T15:15:47.493154+0000","last_unstale":"2024-05-14T15:15:48.497528+0000","last_undegraded":"2024-05-14T15:15:48.497528+0000","last_fullsized":"2024-05-14T15:15:48.497528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:41.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498904+0000","last_change":"2024-05-14T15:15:43.443926+0000","last_active":"2024-05-14T15:15:48.498904+0000","last_peered":"2024-05-14T15:15:48.498904+0000","last_clean":"2024-05-14T15:15:48.498904+0000","last_became_active":"2024-05-14T15:15:43.443583+0000","last_became_peered":"2024-05-14T15:15:43.443583+0000","last_unstale":"2024-05-14T15:15:48.498904+0000","last_undegraded":"2024-05-14T15:15:48.498904+0000","last_fullsized":"2024-05-14T15:15:48.498904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:30.263461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494582+0000","last_change":"2024-05-14T15:15:42.425277+0000","last_active":"2024-05-14T15:15:48.494582+0000","last_peered":"2024-05-14T15:15:48.494582+0000","last_clean":"2024-05-14T15:15:48.494582+0000","last_became_active":"2024-05-14T15:15:42.424947+0000","last_became_peered":"2024-05-14T15:15:42.424947+0000","last_unstale":"2024-05-14T15:15:48.494582+0000","last_undegraded":"2024-05-14T15:15:48.494582+0000","last_fullsized":"2024-05-14T15:15:48.494582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:57.937060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716310+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:15:49.716310+0000","last_peered":"2024-05-14T15:15:49.716310+0000","last_clean":"2024-05-14T15:15:49.716310+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:15:49.716310+0000","last_undegraded":"2024-05-14T15:15:49.716310+0000","last_fullsized":"2024-05-14T15:15:49.716310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495545+0000","last_change":"2024-05-14T15:15:47.472173+0000","last_active":"2024-05-14T15:15:48.495545+0000","last_peered":"2024-05-14T15:15:48.495545+0000","last_clean":"2024-05-14T15:15:48.495545+0000","last_became_active":"2024-05-14T15:15:47.471697+0000","last_became_peered":"2024-05-14T15:15:47.471697+0000","last_unstale":"2024-05-14T15:15:48.495545+0000","last_undegraded":"2024-05-14T15:15:48.495545+0000","last_fullsized":"2024-05-14T15:15:48.495545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:52:45.119238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495230+0000","last_change":"2024-05-14T15:15:43.448608+0000","last_active":"2024-05-14T15:15:48.495230+0000","last_peered":"2024-05-14T15:15:48.495230+0000","last_clean":"2024-05-14T15:15:48.495230+0000","last_became_active":"2024-05-14T15:15:43.448235+0000","last_became_peered":"2024-05-14T15:15:43.448235+0000","last_unstale":"2024-05-14T15:15:48.495230+0000","last_undegraded":"2024-05-14T15:15:48.495230+0000","last_fullsized":"2024-05-14T15:15:48.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:00.533218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.661459+0000","last_change":"2024-05-14T15:15:42.428026+0000","last_active":"2024-05-14T15:15:48.661459+0000","last_peered":"2024-05-14T15:15:48.661459+0000","last_clean":"2024-05-14T15:15:48.661459+0000","last_became_active":"2024-05-14T15:15:42.427537+0000","last_became_peered":"2024-05-14T15:15:42.427537+0000","last_unstale":"2024-05-14T15:15:48.661459+0000","last_undegraded":"2024-05-14T15:15:48.661459+0000","last_fullsized":"2024-05-14T15:15:48.661459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:08:41.086802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717385+0000","last_change":"2024-05-14T15:15:47.490170+0000","last_active":"2024-05-14T15:15:49.717385+0000","last_peered":"2024-05-14T15:15:49.717385+0000","last_clean":"2024-05-14T15:15:49.717385+0000","last_became_active":"2024-05-14T15:15:47.487824+0000","last_became_peered":"2024-05-14T15:15:47.487824+0000","last_unstale":"2024-05-14T15:15:49.717385+0000","last_undegraded":"2024-05-14T15:15:49.717385+0000","last_fullsized":"2024-05-14T15:15:49.717385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:49.464915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720510+0000","last_change":"2024-05-14T15:15:43.464058+0000","last_active":"2024-05-14T15:15:49.720510+0000","last_peered":"2024-05-14T15:15:49.720510+0000","last_clean":"2024-05-14T15:15:49.720510+0000","last_became_active":"2024-05-14T15:15:43.463701+0000","last_became_peered":"2024-05-14T15:15:43.463701+0000","last_unstale":"2024-05-14T15:15:49.720510+0000","last_undegraded":"2024-05-14T15:15:49.720510+0000","last_fullsized":"2024-05-14T15:15:49.720510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498005+0000","last_change":"2024-05-14T15:15:42.411298+0000","last_active":"2024-05-14T15:15:48.498005+0000","last_peered":"2024-05-14T15:15:48.498005+0000","last_clean":"2024-05-14T15:15:48.498005+0000","last_became_active":"2024-05-14T15:15:42.410793+0000","last_became_peered":"2024-05-14T15:15:42.410793+0000","last_unstale":"2024-05-14T15:15:48.498005+0000","last_undegraded":"2024-05-14T15:15:48.498005+0000","last_fullsized":"2024-05-14T15:15:48.498005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497076+0000","last_change":"2024-05-14T15:15:47.467300+0000","last_active":"2024-05-14T15:15:48.497076+0000","last_peered":"2024-05-14T15:15:48.497076+0000","last_clean":"2024-05-14T15:15:48.497076+0000","last_became_active":"2024-05-14T15:15:47.466741+0000","last_became_peered":"2024-05-14T15:15:47.466741+0000","last_unstale":"2024-05-14T15:15:48.497076+0000","last_undegraded":"2024-05-14T15:15:48.497076+0000","last_fullsized":"2024-05-14T15:15:48.497076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:34:53.743066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720754+0000","last_change":"2024-05-14T15:15:43.447908+0000","last_active":"2024-05-14T15:15:49.720754+0000","last_peered":"2024-05-14T15:15:49.720754+0000","last_clean":"2024-05-14T15:15:49.720754+0000","last_became_active":"2024-05-14T15:15:43.447571+0000","last_became_peered":"2024-05-14T15:15:43.447571+0000","last_unstale":"2024-05-14T15:15:49.720754+0000","last_undegraded":"2024-05-14T15:15:49.720754+0000","last_fullsized":"2024-05-14T15:15:49.720754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501459+0000","last_change":"2024-05-14T15:15:42.417527+0000","last_active":"2024-05-14T15:15:48.501459+0000","last_peered":"2024-05-14T15:15:48.501459+0000","last_clean":"2024-05-14T15:15:48.501459+0000","last_became_active":"2024-05-14T15:15:42.417147+0000","last_became_peered":"2024-05-14T15:15:42.417147+0000","last_unstale":"2024-05-14T15:15:48.501459+0000","last_undegraded":"2024-05-14T15:15:48.501459+0000","last_fullsized":"2024-05-14T15:15:48.501459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:56:23.532241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.492764+0000","last_change":"2024-05-14T15:15:47.474753+0000","last_active":"2024-05-14T15:15:48.492764+0000","last_peered":"2024-05-14T15:15:48.492764+0000","last_clean":"2024-05-14T15:15:48.492764+0000","last_became_active":"2024-05-14T15:15:47.471673+0000","last_became_peered":"2024-05-14T15:15:47.471673+0000","last_unstale":"2024-05-14T15:15:48.492764+0000","last_undegraded":"2024-05-14T15:15:48.492764+0000","last_fullsized":"2024-05-14T15:15:48.492764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:24:43.316754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718819+0000","last_change":"2024-05-14T15:15:43.466649+0000","last_active":"2024-05-14T15:15:49.718819+0000","last_peered":"2024-05-14T15:15:49.718819+0000","last_clean":"2024-05-14T15:15:49.718819+0000","last_became_active":"2024-05-14T15:15:43.466206+0000","last_became_peered":"2024-05-14T15:15:43.466206+0000","last_unstale":"2024-05-14T15:15:49.718819+0000","last_undegraded":"2024-05-14T15:15:49.718819+0000","last_fullsized":"2024-05-14T15:15:49.718819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720923+0000","last_change":"2024-05-14T15:15:42.423219+0000","last_active":"2024-05-14T15:15:49.720923+0000","last_peered":"2024-05-14T15:15:49.720923+0000","last_clean":"2024-05-14T15:15:49.720923+0000","last_became_active":"2024-05-14T15:15:42.419631+0000","last_became_peered":"2024-05-14T15:15:42.419631+0000","last_unstale":"2024-05-14T15:15:49.720923+0000","last_undegraded":"2024-05-14T15:15:49.720923+0000","last_fullsized":"2024-05-14T15:15:49.720923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:43.293170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715423+0000","last_change":"2024-05-14T15:15:47.467637+0000","last_active":"2024-05-14T15:15:49.715423+0000","last_peered":"2024-05-14T15:15:49.715423+0000","last_clean":"2024-05-14T15:15:49.715423+0000","last_became_active":"2024-05-14T15:15:47.467193+0000","last_became_peered":"2024-05-14T15:15:47.467193+0000","last_unstale":"2024-05-14T15:15:49.715423+0000","last_undegraded":"2024-05-14T15:15:49.715423+0000","last_fullsized":"2024-05-14T15:15:49.715423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:26.200001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493066+0000","last_change":"2024-05-14T15:15:43.452875+0000","last_active":"2024-05-14T15:15:48.493066+0000","last_peered":"2024-05-14T15:15:48.493066+0000","last_clean":"2024-05-14T15:15:48.493066+0000","last_became_active":"2024-05-14T15:15:43.451854+0000","last_became_peered":"2024-05-14T15:15:43.451854+0000","last_unstale":"2024-05-14T15:15:48.493066+0000","last_undegraded":"2024-05-14T15:15:48.493066+0000","last_fullsized":"2024-05-14T15:15:48.493066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:42.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496486+0000","last_change":"2024-05-14T15:15:42.415604+0000","last_active":"2024-05-14T15:15:48.496486+0000","last_peered":"2024-05-14T15:15:48.496486+0000","last_clean":"2024-05-14T15:15:48.496486+0000","last_became_active":"2024-05-14T15:15:42.415191+0000","last_became_peered":"2024-05-14T15:15:42.415191+0000","last_unstale":"2024-05-14T15:15:48.496486+0000","last_undegraded":"2024-05-14T15:15:48.496486+0000","last_fullsized":"2024-05-14T15:15:48.496486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:57:56.475764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498134+0000","last_change":"2024-05-14T15:15:47.479478+0000","last_active":"2024-05-14T15:15:48.498134+0000","last_peered":"2024-05-14T15:15:48.498134+0000","last_clean":"2024-05-14T15:15:48.498134+0000","last_became_active":"2024-05-14T15:15:47.479035+0000","last_became_peered":"2024-05-14T15:15:47.479035+0000","last_unstale":"2024-05-14T15:15:48.498134+0000","last_undegraded":"2024-05-14T15:15:48.498134+0000","last_fullsized":"2024-05-14T15:15:48.498134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:21.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716155+0000","last_change":"2024-05-14T15:15:43.428593+0000","last_active":"2024-05-14T15:15:49.716155+0000","last_peered":"2024-05-14T15:15:49.716155+0000","last_clean":"2024-05-14T15:15:49.716155+0000","last_became_active":"2024-05-14T15:15:43.427534+0000","last_became_peered":"2024-05-14T15:15:43.427534+0000","last_unstale":"2024-05-14T15:15:49.716155+0000","last_undegraded":"2024-05-14T15:15:49.716155+0000","last_fullsized":"2024-05-14T15:15:49.716155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715821+0000","last_change":"2024-05-14T15:15:42.422410+0000","last_active":"2024-05-14T15:15:49.715821+0000","last_peered":"2024-05-14T15:15:49.715821+0000","last_clean":"2024-05-14T15:15:49.715821+0000","last_became_active":"2024-05-14T15:15:42.422082+0000","last_became_peered":"2024-05-14T15:15:42.422082+0000","last_unstale":"2024-05-14T15:15:49.715821+0000","last_undegraded":"2024-05-14T15:15:49.715821+0000","last_fullsized":"2024-05-14T15:15:49.715821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:03:21.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500190+0000","last_change":"2024-05-14T15:15:47.484942+0000","last_active":"2024-05-14T15:15:48.500190+0000","last_peered":"2024-05-14T15:15:48.500190+0000","last_clean":"2024-05-14T15:15:48.500190+0000","last_became_active":"2024-05-14T15:15:47.484470+0000","last_became_peered":"2024-05-14T15:15:47.484470+0000","last_unstale":"2024-05-14T15:15:48.500190+0000","last_undegraded":"2024-05-14T15:15:48.500190+0000","last_fullsized":"2024-05-14T15:15:48.500190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:55:55.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494248+0000","last_change":"2024-05-14T15:15:43.453259+0000","last_active":"2024-05-14T15:15:48.494248+0000","last_peered":"2024-05-14T15:15:48.494248+0000","last_clean":"2024-05-14T15:15:48.494248+0000","last_became_active":"2024-05-14T15:15:43.452961+0000","last_became_peered":"2024-05-14T15:15:43.452961+0000","last_unstale":"2024-05-14T15:15:48.494248+0000","last_undegraded":"2024-05-14T15:15:48.494248+0000","last_fullsized":"2024-05-14T15:15:48.494248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:22.596094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494575+0000","last_change":"2024-05-14T15:15:42.421393+0000","last_active":"2024-05-14T15:15:48.494575+0000","last_peered":"2024-05-14T15:15:48.494575+0000","last_clean":"2024-05-14T15:15:48.494575+0000","last_became_active":"2024-05-14T15:15:42.420606+0000","last_became_peered":"2024-05-14T15:15:42.420606+0000","last_unstale":"2024-05-14T15:15:48.494575+0000","last_undegraded":"2024-05-14T15:15:48.494575+0000","last_fullsized":"2024-05-14T15:15:48.494575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:54.271748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660641+0000","last_change":"2024-05-14T15:15:47.487448+0000","last_active":"2024-05-14T15:15:48.660641+0000","last_peered":"2024-05-14T15:15:48.660641+0000","last_clean":"2024-05-14T15:15:48.660641+0000","last_became_active":"2024-05-14T15:15:47.487018+0000","last_became_peered":"2024-05-14T15:15:47.487018+0000","last_unstale":"2024-05-14T15:15:48.660641+0000","last_undegraded":"2024-05-14T15:15:48.660641+0000","last_fullsized":"2024-05-14T15:15:48.660641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:46.795075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660071+0000","last_change":"2024-05-14T15:15:43.471275+0000","last_active":"2024-05-14T15:15:48.660071+0000","last_peered":"2024-05-14T15:15:48.660071+0000","last_clean":"2024-05-14T15:15:48.660071+0000","last_became_active":"2024-05-14T15:15:43.469496+0000","last_became_peered":"2024-05-14T15:15:43.469496+0000","last_unstale":"2024-05-14T15:15:48.660071+0000","last_undegraded":"2024-05-14T15:15:48.660071+0000","last_fullsized":"2024-05-14T15:15:48.660071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:04:33.888979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624389+0000","last_change":"2024-05-14T15:15:42.427285+0000","last_active":"2024-05-14T15:15:48.624389+0000","last_peered":"2024-05-14T15:15:48.624389+0000","last_clean":"2024-05-14T15:15:48.624389+0000","last_became_active":"2024-05-14T15:15:42.426859+0000","last_became_peered":"2024-05-14T15:15:42.426859+0000","last_unstale":"2024-05-14T15:15:48.624389+0000","last_undegraded":"2024-05-14T15:15:48.624389+0000","last_fullsized":"2024-05-14T15:15:48.624389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495007+0000","last_change":"2024-05-14T15:15:47.490888+0000","last_active":"2024-05-14T15:15:48.495007+0000","last_peered":"2024-05-14T15:15:48.495007+0000","last_clean":"2024-05-14T15:15:48.495007+0000","last_became_active":"2024-05-14T15:15:47.482649+0000","last_became_peered":"2024-05-14T15:15:47.482649+0000","last_unstale":"2024-05-14T15:15:48.495007+0000","last_undegraded":"2024-05-14T15:15:48.495007+0000","last_fullsized":"2024-05-14T15:15:48.495007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:26.333915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720738+0000","last_change":"2024-05-14T15:15:43.452281+0000","last_active":"2024-05-14T15:15:49.720738+0000","last_peered":"2024-05-14T15:15:49.720738+0000","last_clean":"2024-05-14T15:15:49.720738+0000","last_became_active":"2024-05-14T15:15:43.446861+0000","last_became_peered":"2024-05-14T15:15:43.446861+0000","last_unstale":"2024-05-14T15:15:49.720738+0000","last_undegraded":"2024-05-14T15:15:49.720738+0000","last_fullsized":"2024-05-14T15:15:49.720738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:59.089651+0000","last_change":"2024-05-14T15:15:42.423989+0000","last_active":"2024-05-14T15:15:59.089651+0000","last_peered":"2024-05-14T15:15:59.089651+0000","last_clean":"2024-05-14T15:15:59.089651+0000","last_became_active":"2024-05-14T15:15:42.423577+0000","last_became_peered":"2024-05-14T15:15:42.423577+0000","last_unstale":"2024-05-14T15:15:59.089651+0000","last_undegraded":"2024-05-14T15:15:59.089651+0000","last_fullsized":"2024-05-14T15:15:59.089651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:04.149215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.498558+0000","last_change":"2024-05-14T15:15:47.475619+0000","last_active":"2024-05-14T15:15:48.498558+0000","last_peered":"2024-05-14T15:15:48.498558+0000","last_clean":"2024-05-14T15:15:48.498558+0000","last_became_active":"2024-05-14T15:15:47.471644+0000","last_became_peered":"2024-05-14T15:15:47.471644+0000","last_unstale":"2024-05-14T15:15:48.498558+0000","last_undegraded":"2024-05-14T15:15:48.498558+0000","last_fullsized":"2024-05-14T15:15:48.498558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:20:14.327039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494104+0000","last_change":"2024-05-14T15:15:43.452445+0000","last_active":"2024-05-14T15:15:48.494104+0000","last_peered":"2024-05-14T15:15:48.494104+0000","last_clean":"2024-05-14T15:15:48.494104+0000","last_became_active":"2024-05-14T15:15:43.452110+0000","last_became_peered":"2024-05-14T15:15:43.452110+0000","last_unstale":"2024-05-14T15:15:48.494104+0000","last_undegraded":"2024-05-14T15:15:48.494104+0000","last_fullsized":"2024-05-14T15:15:48.494104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:58.112691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624967+0000","last_change":"2024-05-14T15:15:42.414691+0000","last_active":"2024-05-14T15:15:48.624967+0000","last_peered":"2024-05-14T15:15:48.624967+0000","last_clean":"2024-05-14T15:15:48.624967+0000","last_became_active":"2024-05-14T15:15:42.411431+0000","last_became_peered":"2024-05-14T15:15:42.411431+0000","last_unstale":"2024-05-14T15:15:48.624967+0000","last_undegraded":"2024-05-14T15:15:48.624967+0000","last_fullsized":"2024-05-14T15:15:48.624967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718327+0000","last_change":"2024-05-14T15:15:47.490431+0000","last_active":"2024-05-14T15:15:49.718327+0000","last_peered":"2024-05-14T15:15:49.718327+0000","last_clean":"2024-05-14T15:15:49.718327+0000","last_became_active":"2024-05-14T15:15:47.488871+0000","last_became_peered":"2024-05-14T15:15:47.488871+0000","last_unstale":"2024-05-14T15:15:49.718327+0000","last_undegraded":"2024-05-14T15:15:49.718327+0000","last_fullsized":"2024-05-14T15:15:49.718327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:36.515059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500537+0000","last_change":"2024-05-14T15:15:43.471432+0000","last_active":"2024-05-14T15:15:48.500537+0000","last_peered":"2024-05-14T15:15:48.500537+0000","last_clean":"2024-05-14T15:15:48.500537+0000","last_became_active":"2024-05-14T15:15:43.468506+0000","last_became_peered":"2024-05-14T15:15:43.468506+0000","last_unstale":"2024-05-14T15:15:48.500537+0000","last_undegraded":"2024-05-14T15:15:48.500537+0000","last_fullsized":"2024-05-14T15:15:48.500537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:26:56.675628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721397+0000","last_change":"2024-05-14T15:15:42.425352+0000","last_active":"2024-05-14T15:15:49.721397+0000","last_peered":"2024-05-14T15:15:49.721397+0000","last_clean":"2024-05-14T15:15:49.721397+0000","last_became_active":"2024-05-14T15:15:42.424788+0000","last_became_peered":"2024-05-14T15:15:42.424788+0000","last_unstale":"2024-05-14T15:15:49.721397+0000","last_undegraded":"2024-05-14T15:15:49.721397+0000","last_fullsized":"2024-05-14T15:15:49.721397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:40.231101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623638+0000","last_change":"2024-05-14T15:15:47.495775+0000","last_active":"2024-05-14T15:15:48.623638+0000","last_peered":"2024-05-14T15:15:48.623638+0000","last_clean":"2024-05-14T15:15:48.623638+0000","last_became_active":"2024-05-14T15:15:47.494949+0000","last_became_peered":"2024-05-14T15:15:47.494949+0000","last_unstale":"2024-05-14T15:15:48.623638+0000","last_undegraded":"2024-05-14T15:15:48.623638+0000","last_fullsized":"2024-05-14T15:15:48.623638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:35:24.981952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718767+0000","last_change":"2024-05-14T15:15:43.455269+0000","last_active":"2024-05-14T15:15:49.718767+0000","last_peered":"2024-05-14T15:15:49.718767+0000","last_clean":"2024-05-14T15:15:49.718767+0000","last_became_active":"2024-05-14T15:15:43.454902+0000","last_became_peered":"2024-05-14T15:15:43.454902+0000","last_unstale":"2024-05-14T15:15:49.718767+0000","last_undegraded":"2024-05-14T15:15:49.718767+0000","last_fullsized":"2024-05-14T15:15:49.718767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720229+0000","last_change":"2024-05-14T15:15:42.413462+0000","last_active":"2024-05-14T15:15:49.720229+0000","last_peered":"2024-05-14T15:15:49.720229+0000","last_clean":"2024-05-14T15:15:49.720229+0000","last_became_active":"2024-05-14T15:15:42.412838+0000","last_became_peered":"2024-05-14T15:15:42.412838+0000","last_unstale":"2024-05-14T15:15:49.720229+0000","last_undegraded":"2024-05-14T15:15:49.720229+0000","last_fullsized":"2024-05-14T15:15:49.720229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:37:34.800996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499953+0000","last_change":"2024-05-14T15:15:47.481470+0000","last_active":"2024-05-14T15:15:48.499953+0000","last_peered":"2024-05-14T15:15:48.499953+0000","last_clean":"2024-05-14T15:15:48.499953+0000","last_became_active":"2024-05-14T15:15:47.480935+0000","last_became_peered":"2024-05-14T15:15:47.480935+0000","last_unstale":"2024-05-14T15:15:48.499953+0000","last_undegraded":"2024-05-14T15:15:48.499953+0000","last_fullsized":"2024-05-14T15:15:48.499953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:27.398715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.501300+0000","last_change":"2024-05-14T15:15:47.470190+0000","last_active":"2024-05-14T15:15:48.501300+0000","last_peered":"2024-05-14T15:15:48.501300+0000","last_clean":"2024-05-14T15:15:48.501300+0000","last_became_active":"2024-05-14T15:15:47.469486+0000","last_became_peered":"2024-05-14T15:15:47.469486+0000","last_unstale":"2024-05-14T15:15:48.501300+0000","last_undegraded":"2024-05-14T15:15:48.501300+0000","last_fullsized":"2024-05-14T15:15:48.501300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:02:29.447286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.500142+0000","last_change":"2024-05-14T15:15:43.432186+0000","last_active":"2024-05-14T15:15:48.500142+0000","last_peered":"2024-05-14T15:15:48.500142+0000","last_clean":"2024-05-14T15:15:48.500142+0000","last_became_active":"2024-05-14T15:15:43.431075+0000","last_became_peered":"2024-05-14T15:15:43.431075+0000","last_unstale":"2024-05-14T15:15:48.500142+0000","last_undegraded":"2024-05-14T15:15:48.500142+0000","last_fullsized":"2024-05-14T15:15:48.500142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:57.608006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493573+0000","last_change":"2024-05-14T15:15:42.429681+0000","last_active":"2024-05-14T15:15:48.493573+0000","last_peered":"2024-05-14T15:15:48.493573+0000","last_clean":"2024-05-14T15:15:48.493573+0000","last_became_active":"2024-05-14T15:15:42.426654+0000","last_became_peered":"2024-05-14T15:15:42.426654+0000","last_unstale":"2024-05-14T15:15:48.493573+0000","last_undegraded":"2024-05-14T15:15:48.493573+0000","last_fullsized":"2024-05-14T15:15:48.493573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:21.130230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496123+0000","last_change":"2024-05-14T15:15:47.474072+0000","last_active":"2024-05-14T15:15:48.496123+0000","last_peered":"2024-05-14T15:15:48.496123+0000","last_clean":"2024-05-14T15:15:48.496123+0000","last_became_active":"2024-05-14T15:15:47.473621+0000","last_became_peered":"2024-05-14T15:15:47.473621+0000","last_unstale":"2024-05-14T15:15:48.496123+0000","last_undegraded":"2024-05-14T15:15:48.496123+0000","last_fullsized":"2024-05-14T15:15:48.496123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:49.410071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495656+0000","last_change":"2024-05-14T15:15:43.448709+0000","last_active":"2024-05-14T15:15:48.495656+0000","last_peered":"2024-05-14T15:15:48.495656+0000","last_clean":"2024-05-14T15:15:48.495656+0000","last_became_active":"2024-05-14T15:15:43.448068+0000","last_became_peered":"2024-05-14T15:15:43.448068+0000","last_unstale":"2024-05-14T15:15:48.495656+0000","last_undegraded":"2024-05-14T15:15:48.495656+0000","last_fullsized":"2024-05-14T15:15:48.495656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659737+0000","last_change":"2024-05-14T15:15:42.429751+0000","last_active":"2024-05-14T15:15:48.659737+0000","last_peered":"2024-05-14T15:15:48.659737+0000","last_clean":"2024-05-14T15:15:48.659737+0000","last_became_active":"2024-05-14T15:15:42.429380+0000","last_became_peered":"2024-05-14T15:15:42.429380+0000","last_unstale":"2024-05-14T15:15:48.659737+0000","last_undegraded":"2024-05-14T15:15:48.659737+0000","last_fullsized":"2024-05-14T15:15:48.659737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.494212+0000","last_change":"2024-05-14T15:15:42.428978+0000","last_active":"2024-05-14T15:15:48.494212+0000","last_peered":"2024-05-14T15:15:48.494212+0000","last_clean":"2024-05-14T15:15:48.494212+0000","last_became_active":"2024-05-14T15:15:42.428627+0000","last_became_peered":"2024-05-14T15:15:42.428627+0000","last_unstale":"2024-05-14T15:15:48.494212+0000","last_undegraded":"2024-05-14T15:15:48.494212+0000","last_fullsized":"2024-05-14T15:15:48.494212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:05.667253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499610+0000","last_change":"2024-05-14T15:15:43.447982+0000","last_active":"2024-05-14T15:15:48.499610+0000","last_peered":"2024-05-14T15:15:48.499610+0000","last_clean":"2024-05-14T15:15:48.499610+0000","last_became_active":"2024-05-14T15:15:43.446590+0000","last_became_peered":"2024-05-14T15:15:43.446590+0000","last_unstale":"2024-05-14T15:15:48.499610+0000","last_undegraded":"2024-05-14T15:15:48.499610+0000","last_fullsized":"2024-05-14T15:15:48.499610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:23:05.808230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499664+0000","last_change":"2024-05-14T15:15:47.488195+0000","last_active":"2024-05-14T15:15:48.499664+0000","last_peered":"2024-05-14T15:15:48.499664+0000","last_clean":"2024-05-14T15:15:48.499664+0000","last_became_active":"2024-05-14T15:15:47.487122+0000","last_became_peered":"2024-05-14T15:15:47.487122+0000","last_unstale":"2024-05-14T15:15:48.499664+0000","last_undegraded":"2024-05-14T15:15:48.499664+0000","last_fullsized":"2024-05-14T15:15:48.499664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:10:11.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499154+0000","last_change":"2024-05-14T15:15:42.420415+0000","last_active":"2024-05-14T15:15:48.499154+0000","last_peered":"2024-05-14T15:15:48.499154+0000","last_clean":"2024-05-14T15:15:48.499154+0000","last_became_active":"2024-05-14T15:15:42.420023+0000","last_became_peered":"2024-05-14T15:15:42.420023+0000","last_unstale":"2024-05-14T15:15:48.499154+0000","last_undegraded":"2024-05-14T15:15:48.499154+0000","last_fullsized":"2024-05-14T15:15:48.499154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:41.355516+0000","last_clean_scrub_stamp":"2024-05-14T15:15:41.355516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:22:24.844639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717100+0000","last_change":"2024-05-14T15:15:43.442403+0000","last_active":"2024-05-14T15:15:49.717100+0000","last_peered":"2024-05-14T15:15:49.717100+0000","last_clean":"2024-05-14T15:15:49.717100+0000","last_became_active":"2024-05-14T15:15:43.442018+0000","last_became_peered":"2024-05-14T15:15:43.442018+0000","last_unstale":"2024-05-14T15:15:49.717100+0000","last_undegraded":"2024-05-14T15:15:49.717100+0000","last_fullsized":"2024-05-14T15:15:49.717100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.624856+0000","last_change":"2024-05-14T15:15:47.484476+0000","last_active":"2024-05-14T15:15:48.624856+0000","last_peered":"2024-05-14T15:15:48.624856+0000","last_clean":"2024-05-14T15:15:48.624856+0000","last_became_active":"2024-05-14T15:15:47.483990+0000","last_became_peered":"2024-05-14T15:15:47.483990+0000","last_unstale":"2024-05-14T15:15:48.624856+0000","last_undegraded":"2024-05-14T15:15:48.624856+0000","last_fullsized":"2024-05-14T15:15:48.624856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:46.425286+0000","last_clean_scrub_stamp":"2024-05-14T15:15:46.425286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:44.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717437+0000","last_change":"2024-05-14T15:15:43.452753+0000","last_active":"2024-05-14T15:15:49.717437+0000","last_peered":"2024-05-14T15:15:49.717437+0000","last_clean":"2024-05-14T15:15:49.717437+0000","last_became_active":"2024-05-14T15:15:43.450752+0000","last_became_peered":"2024-05-14T15:15:43.450752+0000","last_unstale":"2024-05-14T15:15:49.717437+0000","last_undegraded":"2024-05-14T15:15:49.717437+0000","last_fullsized":"2024-05-14T15:15:49.717437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:16:09.461561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.623679+0000","last_change":"2024-05-14T15:15:43.459094+0000","last_active":"2024-05-14T15:15:48.623679+0000","last_peered":"2024-05-14T15:15:48.623679+0000","last_clean":"2024-05-14T15:15:48.623679+0000","last_became_active":"2024-05-14T15:15:43.458723+0000","last_became_peered":"2024-05-14T15:15:43.458723+0000","last_unstale":"2024-05-14T15:15:48.623679+0000","last_undegraded":"2024-05-14T15:15:48.623679+0000","last_fullsized":"2024-05-14T15:15:48.623679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:59:33.105060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493568+0000","last_change":"2024-05-14T15:15:43.446191+0000","last_active":"2024-05-14T15:15:48.493568+0000","last_peered":"2024-05-14T15:15:48.493568+0000","last_clean":"2024-05-14T15:15:48.493568+0000","last_became_active":"2024-05-14T15:15:43.445883+0000","last_became_peered":"2024-05-14T15:15:43.445883+0000","last_unstale":"2024-05-14T15:15:48.493568+0000","last_undegraded":"2024-05-14T15:15:48.493568+0000","last_fullsized":"2024-05-14T15:15:48.493568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:09.798116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497390+0000","last_change":"2024-05-14T15:15:43.462772+0000","last_active":"2024-05-14T15:15:48.497390+0000","last_peered":"2024-05-14T15:15:48.497390+0000","last_clean":"2024-05-14T15:15:48.497390+0000","last_became_active":"2024-05-14T15:15:43.458133+0000","last_became_peered":"2024-05-14T15:15:43.458133+0000","last_unstale":"2024-05-14T15:15:48.497390+0000","last_undegraded":"2024-05-14T15:15:48.497390+0000","last_fullsized":"2024-05-14T15:15:48.497390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660954+0000","last_change":"2024-05-14T15:15:43.464641+0000","last_active":"2024-05-14T15:15:48.660954+0000","last_peered":"2024-05-14T15:15:48.660954+0000","last_clean":"2024-05-14T15:15:48.660954+0000","last_became_active":"2024-05-14T15:15:43.464263+0000","last_became_peered":"2024-05-14T15:15:43.464263+0000","last_unstale":"2024-05-14T15:15:48.660954+0000","last_undegraded":"2024-05-14T15:15:48.660954+0000","last_fullsized":"2024-05-14T15:15:48.660954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:03:55.286170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660941+0000","last_change":"2024-05-14T15:15:43.453266+0000","last_active":"2024-05-14T15:15:48.660941+0000","last_peered":"2024-05-14T15:15:48.660941+0000","last_clean":"2024-05-14T15:15:48.660941+0000","last_became_active":"2024-05-14T15:15:43.452641+0000","last_became_peered":"2024-05-14T15:15:43.452641+0000","last_unstale":"2024-05-14T15:15:48.660941+0000","last_undegraded":"2024-05-14T15:15:48.660941+0000","last_fullsized":"2024-05-14T15:15:48.660941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:22.144652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.718639+0000","last_change":"2024-05-14T15:15:43.455928+0000","last_active":"2024-05-14T15:15:49.718639+0000","last_peered":"2024-05-14T15:15:49.718639+0000","last_clean":"2024-05-14T15:15:49.718639+0000","last_became_active":"2024-05-14T15:15:43.454949+0000","last_became_peered":"2024-05-14T15:15:43.454949+0000","last_unstale":"2024-05-14T15:15:49.718639+0000","last_undegraded":"2024-05-14T15:15:49.718639+0000","last_fullsized":"2024-05-14T15:15:49.718639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499982+0000","last_change":"2024-05-14T15:15:43.470552+0000","last_active":"2024-05-14T15:15:48.499982+0000","last_peered":"2024-05-14T15:15:48.499982+0000","last_clean":"2024-05-14T15:15:48.499982+0000","last_became_active":"2024-05-14T15:15:43.453144+0000","last_became_peered":"2024-05-14T15:15:43.453144+0000","last_unstale":"2024-05-14T15:15:48.499982+0000","last_undegraded":"2024-05-14T15:15:48.499982+0000","last_fullsized":"2024-05-14T15:15:48.499982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493251+0000","last_change":"2024-05-14T15:15:43.442622+0000","last_active":"2024-05-14T15:15:48.493251+0000","last_peered":"2024-05-14T15:15:48.493251+0000","last_clean":"2024-05-14T15:15:48.493251+0000","last_became_active":"2024-05-14T15:15:43.442296+0000","last_became_peered":"2024-05-14T15:15:43.442296+0000","last_unstale":"2024-05-14T15:15:48.493251+0000","last_undegraded":"2024-05-14T15:15:48.493251+0000","last_fullsized":"2024-05-14T15:15:48.493251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:14.623568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496080+0000","last_change":"2024-05-14T15:15:43.447439+0000","last_active":"2024-05-14T15:15:48.496080+0000","last_peered":"2024-05-14T15:15:48.496080+0000","last_clean":"2024-05-14T15:15:48.496080+0000","last_became_active":"2024-05-14T15:15:43.446137+0000","last_became_peered":"2024-05-14T15:15:43.446137+0000","last_unstale":"2024-05-14T15:15:48.496080+0000","last_undegraded":"2024-05-14T15:15:48.496080+0000","last_fullsized":"2024-05-14T15:15:48.496080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.716730+0000","last_change":"2024-05-14T15:15:43.449082+0000","last_active":"2024-05-14T15:15:49.716730+0000","last_peered":"2024-05-14T15:15:49.716730+0000","last_clean":"2024-05-14T15:15:49.716730+0000","last_became_active":"2024-05-14T15:15:43.446819+0000","last_became_peered":"2024-05-14T15:15:43.446819+0000","last_unstale":"2024-05-14T15:15:49.716730+0000","last_undegraded":"2024-05-14T15:15:49.716730+0000","last_fullsized":"2024-05-14T15:15:49.716730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:13:58.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.499241+0000","last_change":"2024-05-14T15:15:43.447350+0000","last_active":"2024-05-14T15:15:48.499241+0000","last_peered":"2024-05-14T15:15:48.499241+0000","last_clean":"2024-05-14T15:15:48.499241+0000","last_became_active":"2024-05-14T15:15:43.445520+0000","last_became_peered":"2024-05-14T15:15:43.445520+0000","last_unstale":"2024-05-14T15:15:48.499241+0000","last_undegraded":"2024-05-14T15:15:48.499241+0000","last_fullsized":"2024-05-14T15:15:48.499241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:59:26.779034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720137+0000","last_change":"2024-05-14T15:15:43.455780+0000","last_active":"2024-05-14T15:15:49.720137+0000","last_peered":"2024-05-14T15:15:49.720137+0000","last_clean":"2024-05-14T15:15:49.720137+0000","last_became_active":"2024-05-14T15:15:43.450530+0000","last_became_peered":"2024-05-14T15:15:43.450530+0000","last_unstale":"2024-05-14T15:15:49.720137+0000","last_undegraded":"2024-05-14T15:15:49.720137+0000","last_fullsized":"2024-05-14T15:15:49.720137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:58:51.740889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495537+0000","last_change":"2024-05-14T15:15:43.444694+0000","last_active":"2024-05-14T15:15:48.495537+0000","last_peered":"2024-05-14T15:15:48.495537+0000","last_clean":"2024-05-14T15:15:48.495537+0000","last_became_active":"2024-05-14T15:15:43.444051+0000","last_became_peered":"2024-05-14T15:15:43.444051+0000","last_unstale":"2024-05-14T15:15:48.495537+0000","last_undegraded":"2024-05-14T15:15:48.495537+0000","last_fullsized":"2024-05-14T15:15:48.495537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:37.310772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.625143+0000","last_change":"2024-05-14T15:15:43.460795+0000","last_active":"2024-05-14T15:15:48.625143+0000","last_peered":"2024-05-14T15:15:48.625143+0000","last_clean":"2024-05-14T15:15:48.625143+0000","last_became_active":"2024-05-14T15:15:43.460482+0000","last_became_peered":"2024-05-14T15:15:43.460482+0000","last_unstale":"2024-05-14T15:15:48.625143+0000","last_undegraded":"2024-05-14T15:15:48.625143+0000","last_fullsized":"2024-05-14T15:15:48.625143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496414+0000","last_change":"2024-05-14T15:15:43.454445+0000","last_active":"2024-05-14T15:15:48.496414+0000","last_peered":"2024-05-14T15:15:48.496414+0000","last_clean":"2024-05-14T15:15:48.496414+0000","last_became_active":"2024-05-14T15:15:43.453963+0000","last_became_peered":"2024-05-14T15:15:43.453963+0000","last_unstale":"2024-05-14T15:15:48.496414+0000","last_undegraded":"2024-05-14T15:15:48.496414+0000","last_fullsized":"2024-05-14T15:15:48.496414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:00:17.114782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.493224+0000","last_change":"2024-05-14T15:15:43.451680+0000","last_active":"2024-05-14T15:15:48.493224+0000","last_peered":"2024-05-14T15:15:48.493224+0000","last_clean":"2024-05-14T15:15:48.493224+0000","last_became_active":"2024-05-14T15:15:43.451213+0000","last_became_peered":"2024-05-14T15:15:43.451213+0000","last_unstale":"2024-05-14T15:15:48.493224+0000","last_undegraded":"2024-05-14T15:15:48.493224+0000","last_fullsized":"2024-05-14T15:15:48.493224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:42.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.495636+0000","last_change":"2024-05-14T15:15:43.450048+0000","last_active":"2024-05-14T15:15:48.495636+0000","last_peered":"2024-05-14T15:15:48.495636+0000","last_clean":"2024-05-14T15:15:48.495636+0000","last_became_active":"2024-05-14T15:15:43.447077+0000","last_became_peered":"2024-05-14T15:15:43.447077+0000","last_unstale":"2024-05-14T15:15:48.495636+0000","last_undegraded":"2024-05-14T15:15:48.495636+0000","last_fullsized":"2024-05-14T15:15:48.495636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:44.172442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.659777+0000","last_change":"2024-05-14T15:15:43.452199+0000","last_active":"2024-05-14T15:15:48.659777+0000","last_peered":"2024-05-14T15:15:48.659777+0000","last_clean":"2024-05-14T15:15:48.659777+0000","last_became_active":"2024-05-14T15:15:43.451112+0000","last_became_peered":"2024-05-14T15:15:43.451112+0000","last_unstale":"2024-05-14T15:15:48.659777+0000","last_undegraded":"2024-05-14T15:15:48.659777+0000","last_fullsized":"2024-05-14T15:15:48.659777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:42:06.681675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.660603+0000","last_change":"2024-05-14T15:15:43.467060+0000","last_active":"2024-05-14T15:15:48.660603+0000","last_peered":"2024-05-14T15:15:48.660603+0000","last_clean":"2024-05-14T15:15:48.660603+0000","last_became_active":"2024-05-14T15:15:43.466622+0000","last_became_peered":"2024-05-14T15:15:43.466622+0000","last_unstale":"2024-05-14T15:15:48.660603+0000","last_undegraded":"2024-05-14T15:15:48.660603+0000","last_fullsized":"2024-05-14T15:15:48.660603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:40.234140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.719694+0000","last_change":"2024-05-14T15:15:43.457250+0000","last_active":"2024-05-14T15:15:49.719694+0000","last_peered":"2024-05-14T15:15:49.719694+0000","last_clean":"2024-05-14T15:15:49.719694+0000","last_became_active":"2024-05-14T15:15:43.456942+0000","last_became_peered":"2024-05-14T15:15:43.456942+0000","last_unstale":"2024-05-14T15:15:49.719694+0000","last_undegraded":"2024-05-14T15:15:49.719694+0000","last_fullsized":"2024-05-14T15:15:49.719694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:49.194049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720574+0000","last_change":"2024-05-14T15:15:43.457388+0000","last_active":"2024-05-14T15:15:49.720574+0000","last_peered":"2024-05-14T15:15:49.720574+0000","last_clean":"2024-05-14T15:15:49.720574+0000","last_became_active":"2024-05-14T15:15:43.457024+0000","last_became_peered":"2024-05-14T15:15:43.457024+0000","last_unstale":"2024-05-14T15:15:49.720574+0000","last_undegraded":"2024-05-14T15:15:49.720574+0000","last_fullsized":"2024-05-14T15:15:49.720574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:41:51.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.721313+0000","last_change":"2024-05-14T15:15:43.455894+0000","last_active":"2024-05-14T15:15:49.721313+0000","last_peered":"2024-05-14T15:15:49.721313+0000","last_clean":"2024-05-14T15:15:49.721313+0000","last_became_active":"2024-05-14T15:15:43.455558+0000","last_became_peered":"2024-05-14T15:15:43.455558+0000","last_unstale":"2024-05-14T15:15:49.721313+0000","last_undegraded":"2024-05-14T15:15:49.721313+0000","last_fullsized":"2024-05-14T15:15:49.721313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:45.409566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720231+0000","last_change":"2024-05-14T15:15:43.466235+0000","last_active":"2024-05-14T15:15:49.720231+0000","last_peered":"2024-05-14T15:15:49.720231+0000","last_clean":"2024-05-14T15:15:49.720231+0000","last_became_active":"2024-05-14T15:15:43.465681+0000","last_became_peered":"2024-05-14T15:15:43.465681+0000","last_unstale":"2024-05-14T15:15:49.720231+0000","last_undegraded":"2024-05-14T15:15:49.720231+0000","last_fullsized":"2024-05-14T15:15:49.720231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.496181+0000","last_change":"2024-05-14T15:15:43.450897+0000","last_active":"2024-05-14T15:15:48.496181+0000","last_peered":"2024-05-14T15:15:48.496181+0000","last_clean":"2024-05-14T15:15:48.496181+0000","last_became_active":"2024-05-14T15:15:43.450206+0000","last_became_peered":"2024-05-14T15:15:43.450206+0000","last_unstale":"2024-05-14T15:15:48.496181+0000","last_undegraded":"2024-05-14T15:15:48.496181+0000","last_fullsized":"2024-05-14T15:15:48.496181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.715857+0000","last_change":"2024-05-14T15:15:43.456409+0000","last_active":"2024-05-14T15:15:49.715857+0000","last_peered":"2024-05-14T15:15:49.715857+0000","last_clean":"2024-05-14T15:15:49.715857+0000","last_became_active":"2024-05-14T15:15:43.448064+0000","last_became_peered":"2024-05-14T15:15:43.448064+0000","last_unstale":"2024-05-14T15:15:49.715857+0000","last_undegraded":"2024-05-14T15:15:49.715857+0000","last_fullsized":"2024-05-14T15:15:49.715857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:13.728291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717628+0000","last_change":"2024-05-14T15:15:43.448505+0000","last_active":"2024-05-14T15:15:49.717628+0000","last_peered":"2024-05-14T15:15:49.717628+0000","last_clean":"2024-05-14T15:15:49.717628+0000","last_became_active":"2024-05-14T15:15:43.448130+0000","last_became_peered":"2024-05-14T15:15:43.448130+0000","last_unstale":"2024-05-14T15:15:49.717628+0000","last_undegraded":"2024-05-14T15:15:49.717628+0000","last_fullsized":"2024-05-14T15:15:49.717628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.245523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717789+0000","last_change":"2024-05-14T15:15:43.441410+0000","last_active":"2024-05-14T15:15:49.717789+0000","last_peered":"2024-05-14T15:15:49.717789+0000","last_clean":"2024-05-14T15:15:49.717789+0000","last_became_active":"2024-05-14T15:15:43.440720+0000","last_became_peered":"2024-05-14T15:15:43.440720+0000","last_unstale":"2024-05-14T15:15:49.717789+0000","last_undegraded":"2024-05-14T15:15:49.717789+0000","last_fullsized":"2024-05-14T15:15:49.717789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.717624+0000","last_change":"2024-05-14T15:15:43.449956+0000","last_active":"2024-05-14T15:15:49.717624+0000","last_peered":"2024-05-14T15:15:49.717624+0000","last_clean":"2024-05-14T15:15:49.717624+0000","last_became_active":"2024-05-14T15:15:43.449153+0000","last_became_peered":"2024-05-14T15:15:43.449153+0000","last_unstale":"2024-05-14T15:15:49.717624+0000","last_undegraded":"2024-05-14T15:15:49.717624+0000","last_fullsized":"2024-05-14T15:15:49.717624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:44.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497578+0000","last_change":"2024-05-14T15:15:43.431817+0000","last_active":"2024-05-14T15:15:48.497578+0000","last_peered":"2024-05-14T15:15:48.497578+0000","last_clean":"2024-05-14T15:15:48.497578+0000","last_became_active":"2024-05-14T15:15:43.431329+0000","last_became_peered":"2024-05-14T15:15:43.431329+0000","last_unstale":"2024-05-14T15:15:48.497578+0000","last_undegraded":"2024-05-14T15:15:48.497578+0000","last_fullsized":"2024-05-14T15:15:48.497578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:22:32.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:48.497862+0000","last_change":"2024-05-14T15:15:43.453311+0000","last_active":"2024-05-14T15:15:48.497862+0000","last_peered":"2024-05-14T15:15:48.497862+0000","last_clean":"2024-05-14T15:15:48.497862+0000","last_became_active":"2024-05-14T15:15:43.449852+0000","last_became_peered":"2024-05-14T15:15:43.449852+0000","last_unstale":"2024-05-14T15:15:48.497862+0000","last_undegraded":"2024-05-14T15:15:48.497862+0000","last_fullsized":"2024-05-14T15:15:48.497862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:56:42.489741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-14T15:15:49.720694+0000","last_change":"2024-05-14T15:15:43.468567+0000","last_active":"2024-05-14T15:15:49.720694+0000","last_peered":"2024-05-14T15:15:49.720694+0000","last_clean":"2024-05-14T15:15:49.720694+0000","last_became_active":"2024-05-14T15:15:43.468239+0000","last_became_peered":"2024-05-14T15:15:43.468239+0000","last_unstale":"2024-05-14T15:15:49.720694+0000","last_undegraded":"2024-05-14T15:15:49.720694+0000","last_fullsized":"2024-05-14T15:15:49.720694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:42.369938+0000","last_clean_scrub_stamp":"2024-05-14T15:15:42.369938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:05:03.230168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":109456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":110128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:16:17.474 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T15:16:17.474 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T15:16:17.474 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-14T15:16:17.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-14T15:16:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.780+0000 7f6daf200640 1 Processor -- start 2024-05-14T15:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.780+0000 7f6daf200640 1 -- start start 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.782+0000 7f6daf200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6db00b56a0 0x7f6db00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.782+0000 7f6daf200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6db006d700 0x7f6db006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.782+0000 7f6daf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db00b5ab0 con 0x7f6db015ca80 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.782+0000 7f6daf200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6db006e050 con 0x7f6db00b56a0 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.782+0000 7f6daf200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f6db00b0d10 con 0x7f6db006d700 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dad400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6db015ca80 0x7f6db00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36898/0 (socket says 172.21.15.2:36898) 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dade00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6db00b56a0 0x7f6db00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dad400640 1 -- 172.21.15.2:0/2580451823 learned_addr learned my addr 172.21.15.2:0/2580451823 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dae800640 1 --2- 172.21.15.2:0/2580451823 >> v2:172.21.15.156:3300/0 conn(0x7f6db006d700 0x7f6db006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dade00640 1 -- 172.21.15.2:0/2580451823 >> v2:172.21.15.156:3300/0 conn(0x7f6db006d700 msgr2=0x7f6db006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dade00640 1 --2- 172.21.15.2:0/2580451823 >> v2:172.21.15.156:3300/0 conn(0x7f6db006d700 0x7f6db006db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dade00640 1 -- 172.21.15.2:0/2580451823 >> v1:172.21.15.2:6789/0 conn(0x7f6db015ca80 legacy=0x7f6db00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6dade00640 1 -- 172.21.15.2:0/2580451823 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db00b0ff0 con 0x7f6db00b56a0 2024-05-14T15:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.783+0000 7f6daca00640 1 -- 172.21.15.2:0/2580451823 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201633382 0 0) 0x7f6d98001110 con 0x7f6db015ca80 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.784+0000 7f6dade00640 1 --2- 172.21.15.2:0/2580451823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db00b64e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6db0074090 tx=0x7f6da002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6126bf3fe91272c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daca00640 1 -- 172.21.15.2:0/2580451823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0007740 con 0x7f6db00b56a0 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daca00640 1 -- 172.21.15.2:0/2580451823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00078e0 con 0x7f6db00b56a0 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daca00640 1 -- 172.21.15.2:0/2580451823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0007cb0 con 0x7f6db00b56a0 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 -- 172.21.15.2:0/2580451823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 msgr2=0x7f6db00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 --2- 172.21.15.2:0/2580451823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db00b64e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6db0074090 tx=0x7f6da002a680 comp rx=0 tx=0).stop 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 -- 172.21.15.2:0/2580451823 shutdown_connections 2024-05-14T15:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 --2- 172.21.15.2:0/2580451823 >> v2:172.21.15.156:3300/0 conn(0x7f6db006d700 0x7f6db006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 --2- 172.21.15.2:0/2580451823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db00b64e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 -- 172.21.15.2:0/2580451823 >> 172.21.15.2:0/2580451823 conn(0x7f6db00732e0 msgr2=0x7f6db00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 -- 172.21.15.2:0/2580451823 shutdown_connections 2024-05-14T15:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.785+0000 7f6daf200640 1 -- 172.21.15.2:0/2580451823 wait complete. 2024-05-14T15:16:17.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.788+0000 7f6daf200640 1 Processor -- start 2024-05-14T15:16:17.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.788+0000 7f6daf200640 1 -- start start 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.789+0000 7f6daf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6db006d700 0x7f6db01694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.789+0000 7f6daf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.789+0000 7f6daf200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6db015ca80 0x7f6db014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.789+0000 7f6daf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db00b5180 con 0x7f6db00b56a0 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.789+0000 7f6daf200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6db00b4ea0 con 0x7f6db015ca80 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.789+0000 7f6daf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6db015ce90 con 0x7f6db006d700 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db01527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58988/0 (socket says 172.21.15.2:58988) 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 -- 172.21.15.2:0/1846535058 learned_addr learned my addr 172.21.15.2:0/1846535058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dade00640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6db006d700 0x7f6db01694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dae800640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6db015ca80 0x7f6db014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 -- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6db006d700 msgr2=0x7f6db01694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6db006d700 0x7f6db01694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 -- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6db015ca80 msgr2=0x7f6db014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6db015ca80 0x7f6db014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 -- 172.21.15.2:0/1846535058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db0148ad0 con 0x7f6db00b56a0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dade00640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6db006d700 0x7f6db01694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dae800640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6db015ca80 0x7f6db014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.790+0000 7f6dad400640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db01527d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800c3f0 tx=0x7f6d9800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.791+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980074e0 con 0x7f6db00b56a0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.791+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d980047e0 con 0x7f6db00b56a0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.791+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98004bd0 con 0x7f6db00b56a0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.791+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db0148db0 con 0x7f6db00b56a0 2024-05-14T15:16:17.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.791+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db0149370 con 0x7f6db00b56a0 2024-05-14T15:16:17.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.792+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db0148300 con 0x7f6db00b56a0 2024-05-14T15:16:17.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.793+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d98011070 con 0x7f6db00b56a0 2024-05-14T15:16:17.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.794+0000 7f6da6000640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6d8c0762d0 0x7f6d8c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:17.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.794+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6d98097550 con 0x7f6db00b56a0 2024-05-14T15:16:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.795+0000 7f6dade00640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6d8c0762d0 0x7f6d8c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.796+0000 7f6dade00640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6d8c0762d0 0x7f6d8c0787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6da0034000 tx=0x7f6da002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:17.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:17.799+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6db00b5ab0 con 0x7f6db00b56a0 2024-05-14T15:16:18.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.039+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6db0073e40 con 0x7f6db00b56a0 2024-05-14T15:16:18.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.040+0000 7f6da6000640 1 -- 172.21.15.2:0/1846535058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6d98060ad0 con 0x7f6db00b56a0 2024-05-14T15:16:18.038 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:18.038 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6d8c0762d0 msgr2=0x7f6d8c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6d8c0762d0 0x7f6d8c0787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6da0034000 tx=0x7f6da002f000 comp rx=0 tx=0).stop 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 msgr2=0x7f6db01527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db01527d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800c3f0 tx=0x7f6d9800c8b0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 shutdown_connections 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6d8c0762d0 0x7f6d8c0787e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6db015ca80 0x7f6db014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db00b56a0 0x7f6db01527d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 --2- 172.21.15.2:0/1846535058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6db006d700 0x7f6db01694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.042+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 >> 172.21.15.2:0/1846535058 conn(0x7f6db00732e0 msgr2=0x7f6db0157120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:18.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.043+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 shutdown_connections 2024-05-14T15:16:18.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.043+0000 7f6daf200640 1 -- 172.21.15.2:0/1846535058 wait complete. 2024-05-14T15:16:18.067 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-14T15:16:18.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:18.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.348+0000 7fcff1200640 1 Processor -- start 2024-05-14T15:16:18.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.348+0000 7fcff1200640 1 -- start start 2024-05-14T15:16:18.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.350+0000 7fcff1200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 0x7fcfec0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.350+0000 7fcff1200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcfec06d700 0x7fcfec06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.350+0000 7fcff1200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfec0d1460 con 0x7fcfec15bb90 2024-05-14T15:16:18.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.350+0000 7fcff1200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fcfec15eb50 con 0x7fcfec06d700 2024-05-14T15:16:18.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.350+0000 7fcff1200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcfec15f350 con 0x7fcfec071530 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.350+0000 7fcfe9e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcfec15bb90 0x7fcfec15e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36914/0 (socket says 172.21.15.2:36914) 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.351+0000 7fcfe9e00640 1 -- 172.21.15.2:0/3880251824 learned_addr learned my addr 172.21.15.2:0/3880251824 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.351+0000 7fcfe3e00640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 0x7fcfec0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.351+0000 7fcfea800640 1 --2- 172.21.15.2:0/3880251824 >> v2:172.21.15.156:3300/0 conn(0x7fcfec06d700 0x7fcfec06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.351+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462526869 0 0) 0x7fcfec0d1460 con 0x7fcfec15bb90 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.351+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd0003520 con 0x7fcfec15bb90 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 8257145 0 0) 0x7fcfd0003520 con 0x7fcfec15bb90 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 msgr2=0x7fcfec0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 0x7fcfec0af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 >> v2:172.21.15.156:3300/0 conn(0x7fcfec06d700 msgr2=0x7fcfec06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 --2- 172.21.15.2:0/3880251824 >> v2:172.21.15.156:3300/0 conn(0x7fcfec06d700 0x7fcfec06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec06e050 con 0x7fcfec15bb90 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fcfdc0016f0 con 0x7fcfec15bb90 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe3e00640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 0x7fcfec0af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 >> v1:172.21.15.2:6789/0 conn(0x7fcfec15bb90 legacy=0x7fcfec15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfd0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 0x7fcfd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd0004d40 0x7fcfd0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec15eb50 con 0x7fcfd0003a00 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec15f350 con 0x7fcfd0004d40 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd000baa0 con 0x7fcfec071530 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfd0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfea800640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd0004d40 0x7fcfd0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9e00640 1 -- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 msgr2=0x7fcfd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.352+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec071530 0x7fcfd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.353+0000 7fcfe9e00640 1 -- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd0004d40 msgr2=0x7fcfd0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.353+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd0004d40 0x7fcfd0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.353+0000 7fcfe9e00640 1 -- 172.21.15.2:0/3880251824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd0003520 con 0x7fcfd0003a00 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.354+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfd0003e70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc007fd0 tx=0x7fcfd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5177c80fd8015eca server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.354+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc007d50 con 0x7fcfd0003a00 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.354+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc02e070 con 0x7fcfd0003a00 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.354+0000 7fcfe9400640 1 -- 172.21.15.2:0/3880251824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc005d30 con 0x7fcfd0003a00 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcff1200640 1 -- 172.21.15.2:0/3880251824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 msgr2=0x7fcfd0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcff1200640 1 --2- 172.21.15.2:0/3880251824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfd0003e70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc007fd0 tx=0x7fcfd0005830 comp rx=0 tx=0).stop 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcfea800640 1 -- 172.21.15.2:0/3880251824 reap_dead start 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcff1200640 1 -- 172.21.15.2:0/3880251824 shutdown_connections 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcff1200640 1 -- 172.21.15.2:0/3880251824 >> 172.21.15.2:0/3880251824 conn(0x7fcfec0d1d10 msgr2=0x7fcfec0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcff1200640 1 -- 172.21.15.2:0/3880251824 shutdown_connections 2024-05-14T15:16:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.355+0000 7fcff1200640 1 -- 172.21.15.2:0/3880251824 wait complete. 2024-05-14T15:16:18.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.358+0000 7fcff1200640 1 Processor -- start 2024-05-14T15:16:18.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.358+0000 7fcff1200640 1 -- start start 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.359+0000 7fcff1200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfec0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.359+0000 7fcff1200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec15a7e0 0x7fcfec0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.359+0000 7fcff1200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfec0b5f90 0x7fcfec09d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.359+0000 7fcff1200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec0ae880 con 0x7fcfd0003a00 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.359+0000 7fcff1200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec15f070 con 0x7fcfec0b5f90 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.359+0000 7fcff1200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fcfec0aeb60 con 0x7fcfec15a7e0 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfec0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfec0b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59010/0 (socket says 172.21.15.2:59010) 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 -- 172.21.15.2:0/724358121 learned_addr learned my addr 172.21.15.2:0/724358121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe3e00640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec15a7e0 0x7fcfec0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfea800640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfec0b5f90 0x7fcfec09d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 -- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec15a7e0 msgr2=0x7fcfec0b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec15a7e0 0x7fcfec0b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 -- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfec0b5f90 msgr2=0x7fcfec09d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfec0b5f90 0x7fcfec09d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.360+0000 7fcfe9e00640 1 -- 172.21.15.2:0/724358121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec1e96c0 con 0x7fcfd0003a00 2024-05-14T15:16:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.361+0000 7fcfe9e00640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfec0b5510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c380 tx=0x7fcfec071990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.361+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc043070 con 0x7fcfd0003a00 2024-05-14T15:16:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.361+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc007480 con 0x7fcfd0003a00 2024-05-14T15:16:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.361+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc007d50 con 0x7fcfd0003a00 2024-05-14T15:16:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.361+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec1e99a0 con 0x7fcfd0003a00 2024-05-14T15:16:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.361+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec1e9f60 con 0x7fcfd0003a00 2024-05-14T15:16:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.362+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec0b63a0 con 0x7fcfd0003a00 2024-05-14T15:16:18.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.363+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcfdc033470 con 0x7fcfd0003a00 2024-05-14T15:16:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.364+0000 7fcfe2000640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcfc80762d0 0x7fcfc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.365+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcfdc0b7770 con 0x7fcfd0003a00 2024-05-14T15:16:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.365+0000 7fcfe3e00640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcfc80762d0 0x7fcfc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.366+0000 7fcfe3e00640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcfc80762d0 0x7fcfc80787e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ccc70 tx=0x7fcfd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:18.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.370+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcfec06e050 con 0x7fcfd0003a00 2024-05-14T15:16:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.630+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfec050870 con 0x7fcfd0003a00 2024-05-14T15:16:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.631+0000 7fcfe2000640 1 -- 172.21.15.2:0/724358121 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7fcfdc080610 con 0x7fcfd0003a00 2024-05-14T15:16:18.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:18.629 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcfc80762d0 msgr2=0x7fcfc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcfc80762d0 0x7fcfc80787e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ccc70 tx=0x7fcfd4008040 comp rx=0 tx=0).stop 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 msgr2=0x7fcfec0b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfec0b5510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c380 tx=0x7fcfec071990 comp rx=0 tx=0).stop 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 shutdown_connections 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fcfc80762d0 0x7fcfc80787e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfec0b5f90 0x7fcfec09d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfec15a7e0 0x7fcfec0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 --2- 172.21.15.2:0/724358121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd0003a00 0x7fcfec0b5510 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 >> 172.21.15.2:0/724358121 conn(0x7fcfec0d1d10 msgr2=0x7fcfec0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 shutdown_connections 2024-05-14T15:16:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.634+0000 7fcff1200640 1 -- 172.21.15.2:0/724358121 wait complete. 2024-05-14T15:16:18.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.938+0000 7f5b16c00640 1 Processor -- start 2024-05-14T15:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.938+0000 7f5b16c00640 1 -- start start 2024-05-14T15:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b16c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b1015cf60 0x7f5b100ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b16c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b100aeea0 0x7f5b1006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b16c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b100b4950 con 0x7f5b1006dc40 2024-05-14T15:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b16c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f5b100af2b0 con 0x7f5b100aeea0 2024-05-14T15:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b16c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1006e050 con 0x7f5b1015cf60 2024-05-14T15:16:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b0f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b100aeea0 0x7f5b1006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b0f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b100aeea0 0x7f5b1006d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59012/0 (socket says 172.21.15.2:59012) 2024-05-14T15:16:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.940+0000 7f5b0f400640 1 -- 172.21.15.2:0/527794661 learned_addr learned my addr 172.21.15.2:0/527794661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.941+0000 7f5b0fe00640 1 --2- 172.21.15.2:0/527794661 >> v2:172.21.15.156:3300/0 conn(0x7f5b1015cf60 0x7f5b100ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.941+0000 7f5b0f400640 1 -- 172.21.15.2:0/527794661 >> v2:172.21.15.156:3300/0 conn(0x7f5b1015cf60 msgr2=0x7f5b100ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.941+0000 7f5b0f400640 1 --2- 172.21.15.2:0/527794661 >> v2:172.21.15.156:3300/0 conn(0x7f5b1015cf60 0x7f5b100ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.941+0000 7f5b0f400640 1 -- 172.21.15.2:0/527794661 >> v1:172.21.15.156:6789/0 conn(0x7f5b1006dc40 legacy=0x7f5b100705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.941+0000 7f5b0f400640 1 -- 172.21.15.2:0/527794661 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100b5f70 con 0x7f5b100aeea0 2024-05-14T15:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.942+0000 7f5b0f400640 1 --2- 172.21.15.2:0/527794661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b100aeea0 0x7f5b1006d700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b100719d0 tx=0x7f5afc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2178d4e201ddd4f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.942+0000 7f5b0ea00640 1 -- 172.21.15.2:0/527794661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc037070 con 0x7f5b100aeea0 2024-05-14T15:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.942+0000 7f5b0ea00640 1 -- 172.21.15.2:0/527794661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc032440 con 0x7f5b100aeea0 2024-05-14T15:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.942+0000 7f5b0ea00640 1 -- 172.21.15.2:0/527794661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc032810 con 0x7f5b100aeea0 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.943+0000 7f5b16c00640 1 -- 172.21.15.2:0/527794661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b100aeea0 msgr2=0x7f5b1006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.943+0000 7f5b16c00640 1 --2- 172.21.15.2:0/527794661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b100aeea0 0x7f5b1006d700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b100719d0 tx=0x7f5afc02a140 comp rx=0 tx=0).stop 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.943+0000 7f5b16c00640 1 -- 172.21.15.2:0/527794661 shutdown_connections 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.943+0000 7f5b16c00640 1 --2- 172.21.15.2:0/527794661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b100aeea0 0x7f5b1006d700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.943+0000 7f5b16c00640 1 --2- 172.21.15.2:0/527794661 >> v2:172.21.15.156:3300/0 conn(0x7f5b1015cf60 0x7f5b100ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.943+0000 7f5b16c00640 1 -- 172.21.15.2:0/527794661 >> 172.21.15.2:0/527794661 conn(0x7f5b100d1d10 msgr2=0x7f5b100734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.944+0000 7f5b16c00640 1 -- 172.21.15.2:0/527794661 shutdown_connections 2024-05-14T15:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.944+0000 7f5b16c00640 1 -- 172.21.15.2:0/527794661 wait complete. 2024-05-14T15:16:18.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.946+0000 7f5b16c00640 1 Processor -- start 2024-05-14T15:16:18.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.946+0000 7f5b16c00640 1 -- start start 2024-05-14T15:16:18.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.947+0000 7f5b16c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b1006dc40 0x7f5b10144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b16c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b100aeea0 0x7f5b10143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b16c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 0x7f5b101e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b16c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10160d90 con 0x7f5b1015cf60 2024-05-14T15:16:18.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b16c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10160ab0 con 0x7f5b100aeea0 2024-05-14T15:16:18.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b16c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5b10161070 con 0x7f5b1006dc40 2024-05-14T15:16:18.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 0x7f5b101e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 0x7f5b101e71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59018/0 (socket says 172.21.15.2:59018) 2024-05-14T15:16:18.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 -- 172.21.15.2:0/262246448 learned_addr learned my addr 172.21.15.2:0/262246448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b0f400640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b100aeea0 0x7f5b10143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b0fe00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b1006dc40 0x7f5b10144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 -- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b1006dc40 msgr2=0x7f5b10144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b1006dc40 0x7f5b10144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 -- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b100aeea0 msgr2=0x7f5b10143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b100aeea0 0x7f5b10143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b14c00640 1 -- 172.21.15.2:0/262246448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b10144c40 con 0x7f5b1015cf60 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b0f400640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b100aeea0 0x7f5b10143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.948+0000 7f5b0fe00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b1006dc40 0x7f5b10144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.949+0000 7f5b14c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 0x7f5b101e71a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800b9e0 tx=0x7f5b0800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.949+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08003b70 con 0x7f5b1015cf60 2024-05-14T15:16:18.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.949+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08003d10 con 0x7f5b1015cf60 2024-05-14T15:16:18.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.949+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b10144f20 con 0x7f5b1015cf60 2024-05-14T15:16:18.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.949+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800cb60 con 0x7f5b1015cf60 2024-05-14T15:16:18.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.949+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b101454e0 con 0x7f5b1015cf60 2024-05-14T15:16:18.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.950+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b10050870 con 0x7f5b1015cf60 2024-05-14T15:16:18.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.953+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b0800cd00 con 0x7f5b1015cf60 2024-05-14T15:16:18.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.954+0000 7f5b07e00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5af00762d0 0x7f5af00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:18.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.954+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5b080978a0 con 0x7f5b1015cf60 2024-05-14T15:16:18.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.955+0000 7f5b0fe00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5af00762d0 0x7f5af00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.956+0000 7f5b0fe00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5af00762d0 0x7f5af00787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006fd0 tx=0x7f5b00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:18.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:18.959+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b08060d90 con 0x7f5b1015cf60 2024-05-14T15:16:19.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.207+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b10146e20 con 0x7f5b1015cf60 2024-05-14T15:16:19.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.208+0000 7f5b07e00640 1 -- 172.21.15.2:0/262246448 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7f5b08060690 con 0x7f5b1015cf60 2024-05-14T15:16:19.207 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:19.207 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:19.207 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5af00762d0 msgr2=0x7f5af00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5af00762d0 0x7f5af00787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006fd0 tx=0x7f5b00008040 comp rx=0 tx=0).stop 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 msgr2=0x7f5b101e71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 0x7f5b101e71a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800b9e0 tx=0x7f5b0800bea0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 shutdown_connections 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5af00762d0 0x7f5af00787e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b100aeea0 0x7f5b10143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b1015cf60 0x7f5b101e71a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 --2- 172.21.15.2:0/262246448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b1006dc40 0x7f5b10144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 >> 172.21.15.2:0/262246448 conn(0x7f5b100d1d10 msgr2=0x7f5b100b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 shutdown_connections 2024-05-14T15:16:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.211+0000 7f5b16c00640 1 -- 172.21.15.2:0/262246448 wait complete. 2024-05-14T15:16:19.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:19.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.502+0000 7efc20c00640 1 Processor -- start 2024-05-14T15:16:19.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.502+0000 7efc20c00640 1 -- start start 2024-05-14T15:16:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc20c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc20c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc1c0ae750 0x7efc1c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc20c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc1c06e050 con 0x7efc1c0d1050 2024-05-14T15:16:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc20c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7efc1c1624e0 con 0x7efc1c0ae750 2024-05-14T15:16:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc20c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7efc1c1618d0 con 0x7efc1c06d700 2024-05-14T15:16:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc1be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc1c0ae750 0x7efc1c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc1be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc1c0ae750 0x7efc1c0aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59024/0 (socket says 172.21.15.2:59024) 2024-05-14T15:16:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc1be00640 1 -- 172.21.15.2:0/2428158688 learned_addr learned my addr 172.21.15.2:0/2428158688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.505+0000 7efc13e00640 1 --2- 172.21.15.2:0/2428158688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.506+0000 7efc1be00640 1 -- 172.21.15.2:0/2428158688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 msgr2=0x7efc1c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.506+0000 7efc1be00640 1 --2- 172.21.15.2:0/2428158688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.506+0000 7efc1be00640 1 -- 172.21.15.2:0/2428158688 >> v1:172.21.15.2:6789/0 conn(0x7efc1c0d1050 legacy=0x7efc1c070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.506+0000 7efc1be00640 1 -- 172.21.15.2:0/2428158688 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1c161bb0 con 0x7efc1c0ae750 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.506+0000 7efc1aa00640 1 -- 172.21.15.2:0/2428158688 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107244703 0 0) 0x7efc0c001110 con 0x7efc1c0d1050 2024-05-14T15:16:19.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.507+0000 7efc1be00640 1 --2- 172.21.15.2:0/2428158688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c0aeb60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc14009e50 tx=0x7efc1402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c69a4226587ca54 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:19.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.507+0000 7efc1aa00640 1 -- 172.21.15.2:0/2428158688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14036070 con 0x7efc1c0ae750 2024-05-14T15:16:19.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.507+0000 7efc1aa00640 1 -- 172.21.15.2:0/2428158688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc14031600 con 0x7efc1c0ae750 2024-05-14T15:16:19.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.507+0000 7efc1aa00640 1 -- 172.21.15.2:0/2428158688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc140319d0 con 0x7efc1c0ae750 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 -- 172.21.15.2:0/2428158688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 msgr2=0x7efc1c0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 --2- 172.21.15.2:0/2428158688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c0aeb60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc14009e50 tx=0x7efc1402a710 comp rx=0 tx=0).stop 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 -- 172.21.15.2:0/2428158688 shutdown_connections 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 --2- 172.21.15.2:0/2428158688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c0aeb60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 --2- 172.21.15.2:0/2428158688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 -- 172.21.15.2:0/2428158688 >> 172.21.15.2:0/2428158688 conn(0x7efc1c0732e0 msgr2=0x7efc1c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 -- 172.21.15.2:0/2428158688 shutdown_connections 2024-05-14T15:16:19.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.508+0000 7efc20c00640 1 -- 172.21.15.2:0/2428158688 wait complete. 2024-05-14T15:16:19.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.510+0000 7efc20c00640 1 Processor -- start 2024-05-14T15:16:19.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.510+0000 7efc20c00640 1 -- start start 2024-05-14T15:16:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc20c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc20c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc20c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c0d1050 0x7efc1c1fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc20c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c071050 con 0x7efc1c0ae750 2024-05-14T15:16:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc20c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c162170 con 0x7efc1c0d1050 2024-05-14T15:16:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc20c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7efc1c15f110 con 0x7efc1c06d700 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc13e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc13e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59034/0 (socket says 172.21.15.2:59034) 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc13e00640 1 -- 172.21.15.2:0/1068742293 learned_addr learned my addr 172.21.15.2:0/1068742293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.512+0000 7efc1b400640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13e00640 1 -- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 msgr2=0x7efc1c1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13e00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c1574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc1be00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c0d1050 0x7efc1c1fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13e00640 1 -- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c0d1050 msgr2=0x7efc1c1fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13e00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c0d1050 0x7efc1c1fa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13e00640 1 -- 172.21.15.2:0/1068742293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1c145250 con 0x7efc1c0ae750 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13e00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c144d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc0400d620 tx=0x7efc0400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400b620 con 0x7efc1c0ae750 2024-05-14T15:16:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc04019070 con 0x7efc1c0ae750 2024-05-14T15:16:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1c156440 con 0x7efc1c0ae750 2024-05-14T15:16:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400ba00 con 0x7efc1c0ae750 2024-05-14T15:16:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.513+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1c156a00 con 0x7efc1c0ae750 2024-05-14T15:16:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.514+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1c050870 con 0x7efc1c0ae750 2024-05-14T15:16:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.516+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc0400bba0 con 0x7efc1c0ae750 2024-05-14T15:16:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.517+0000 7efc13400640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efbf8076300 0x7efbf8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.517+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efc04097e80 con 0x7efc1c0ae750 2024-05-14T15:16:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.517+0000 7efc1b400640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efbf8076300 0x7efbf8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.519+0000 7efc1b400640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efbf8076300 0x7efbf8078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc0c000f60 tx=0x7efc0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.522+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc04061370 con 0x7efc1c0ae750 2024-05-14T15:16:19.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.725+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc1c1561d0 con 0x7efc1c0ae750 2024-05-14T15:16:19.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.727+0000 7efc13400640 1 -- 172.21.15.2:0/1068742293 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18446 (secure 0 0 0) 0x7efc04060c70 con 0x7efc1c0ae750 2024-05-14T15:16:19.726 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:19.726 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:15:48.027230+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efbf8076300 msgr2=0x7efbf8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efbf8076300 0x7efbf8078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc0c000f60 tx=0x7efc0c009040 comp rx=0 tx=0).stop 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 msgr2=0x7efc1c144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c144d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc0400d620 tx=0x7efc0400dae0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 shutdown_connections 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7efbf8076300 0x7efbf8078810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c0d1050 0x7efc1c1fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc1c0ae750 0x7efc1c144d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 --2- 172.21.15.2:0/1068742293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc1c06d700 0x7efc1c1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:19.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.729+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 >> 172.21.15.2:0/1068742293 conn(0x7efc1c0732e0 msgr2=0x7efc1c0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:19.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.730+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 shutdown_connections 2024-05-14T15:16:19.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:19.730+0000 7efc20c00640 1 -- 172.21.15.2:0/1068742293 wait complete. 2024-05-14T15:16:19.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.033+0000 7ff1fa000640 1 Processor -- start 2024-05-14T15:16:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.033+0000 7ff1fa000640 1 -- start start 2024-05-14T15:16:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1fa000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff1f4165af0 0x7ff1f4167f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1fa000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f40b4950 con 0x7ff1f415cf60 2024-05-14T15:16:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1fa000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f40b5f70 con 0x7ff1f406d700 2024-05-14T15:16:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1fa000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f4161870 con 0x7ff1f4165af0 2024-05-14T15:16:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1f3400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1f415cf60 0x7ff1f40ae960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55170/0 (socket says 172.21.15.2:55170) 2024-05-14T15:16:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1f3400640 1 -- 172.21.15.2:0/2585897325 learned_addr learned my addr 172.21.15.2:0/2585897325 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.036+0000 7ff1f3e00640 1 --2- 172.21.15.2:0/2585897325 >> v2:172.21.15.156:3300/0 conn(0x7ff1f4165af0 0x7ff1f4167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165899892 0 0) 0x7ff1f40b4950 con 0x7ff1f415cf60 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1d8003520 con 0x7ff1f415cf60 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3569281726 0 0) 0x7ff1d8003520 con 0x7ff1f415cf60 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 >> v2:172.21.15.156:3300/0 conn(0x7ff1f4165af0 msgr2=0x7ff1f4167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 --2- 172.21.15.2:0/2585897325 >> v2:172.21.15.156:3300/0 conn(0x7ff1f4165af0 0x7ff1f4167f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 >> v1:172.21.15.156:6789/0 conn(0x7ff1f406d700 legacy=0x7ff1f406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f4160ab0 con 0x7ff1f415cf60 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7ff1e40016f0 con 0x7ff1f415cf60 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 >> v1:172.21.15.2:6789/0 conn(0x7ff1f415cf60 legacy=0x7ff1f40ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1d8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1d8004800 0x7ff1d8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1d8005350 0x7ff1d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4161870 con 0x7ff1d8003a50 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d800c280 con 0x7ff1d8005350 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.037+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d800c480 con 0x7ff1d8004800 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1d8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f2a00640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1d8004800 0x7ff1d8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3e00640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1d8005350 0x7ff1d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3400640 1 -- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1d8004800 msgr2=0x7ff1d8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1d8004800 0x7ff1d8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3400640 1 -- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1d8005350 msgr2=0x7ff1d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1d8005350 0x7ff1d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3400640 1 -- 172.21.15.2:0/2585897325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d8003520 con 0x7ff1d8003a50 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3e00640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1d8005350 0x7ff1d800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f2a00640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1d8004800 0x7ff1d8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.038+0000 7ff1f3e00640 1 -- 172.21.15.2:0/2585897325 reap_dead start 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.039+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1d8003ec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c2f0 tx=0x7ff1d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dfea017d79b62e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.039+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4007d90 con 0x7ff1d8003a50 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.039+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4005af0 con 0x7ff1d8003a50 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.039+0000 7ff1f2000640 1 -- 172.21.15.2:0/2585897325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4007070 con 0x7ff1d8003a50 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 -- 172.21.15.2:0/2585897325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 msgr2=0x7ff1d8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1d8003ec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c2f0 tx=0x7ff1d8005830 comp rx=0 tx=0).stop 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 -- 172.21.15.2:0/2585897325 shutdown_connections 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2585897325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1d8003ec0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 -- 172.21.15.2:0/2585897325 >> 172.21.15.2:0/2585897325 conn(0x7ff1f40d1d10 msgr2=0x7ff1f40734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 -- 172.21.15.2:0/2585897325 shutdown_connections 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.040+0000 7ff1fa000640 1 -- 172.21.15.2:0/2585897325 wait complete. 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.043+0000 7ff1fa000640 1 Processor -- start 2024-05-14T15:16:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.043+0000 7ff1fa000640 1 -- start start 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.044+0000 7ff1fa000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1f414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.044+0000 7ff1fa000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1f415a5e0 0x7ff1f40cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.044+0000 7ff1fa000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1f414b1b0 0x7ff1f40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1fa000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4161350 con 0x7ff1d8003a50 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1fa000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4161070 con 0x7ff1f415a5e0 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1fa000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f40af4d0 con 0x7ff1f414b1b0 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1f414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1f414aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46372/0 (socket says 172.21.15.2:46372) 2024-05-14T15:16:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 -- 172.21.15.2:0/2331780102 learned_addr learned my addr 172.21.15.2:0/2331780102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f2a00640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1f415a5e0 0x7ff1f40cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3e00640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1f414b1b0 0x7ff1f40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 -- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1f414b1b0 msgr2=0x7ff1f40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1f414b1b0 0x7ff1f40ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 -- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1f415a5e0 msgr2=0x7ff1f40cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1f415a5e0 0x7ff1f40cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3400640 1 -- 172.21.15.2:0/2331780102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f414b930 con 0x7ff1d8003a50 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.045+0000 7ff1f3e00640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1f414b1b0 0x7ff1f40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.046+0000 7ff1f3400640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1f414aad0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c2f0 tx=0x7ff1e40019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.046+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4037040 con 0x7ff1d8003a50 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.046+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4041070 con 0x7ff1d8003a50 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.046+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4004a00 con 0x7ff1d8003a50 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.046+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f4154000 con 0x7ff1d8003a50 2024-05-14T15:16:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.046+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f41545c0 con 0x7ff1d8003a50 2024-05-14T15:16:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.048+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f4050870 con 0x7ff1d8003a50 2024-05-14T15:16:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.049+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff1e4004ba0 con 0x7ff1d8003a50 2024-05-14T15:16:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.050+0000 7ff1eb400640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff1d40762d0 0x7ff1d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.050+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff1e40b7730 con 0x7ff1d8003a50 2024-05-14T15:16:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.051+0000 7ff1f2a00640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff1d40762d0 0x7ff1d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.052+0000 7ff1f2a00640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff1d40762d0 0x7ff1d40787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40cfa10 tx=0x7ff1e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.055+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff1e40016b0 con 0x7ff1d8003a50 2024-05-14T15:16:20.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.312+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1f4157480 con 0x7ff1d8003a50 2024-05-14T15:16:20.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.313+0000 7ff1eb400640 1 -- 172.21.15.2:0/2331780102 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7ff1e4080d40 con 0x7ff1d8003a50 2024-05-14T15:16:20.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:20.312 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:20.312 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff1d40762d0 msgr2=0x7ff1d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff1d40762d0 0x7ff1d40787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40cfa10 tx=0x7ff1e0009040 comp rx=0 tx=0).stop 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 msgr2=0x7ff1f414aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1f414aad0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c2f0 tx=0x7ff1e40019f0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 shutdown_connections 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff1d40762d0 0x7ff1d40787e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1f415a5e0 0x7ff1f40cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1f414b1b0 0x7ff1f40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 --2- 172.21.15.2:0/2331780102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d8003a50 0x7ff1f414aad0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 >> 172.21.15.2:0/2331780102 conn(0x7ff1f40d1d10 msgr2=0x7ff1f40ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 shutdown_connections 2024-05-14T15:16:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:20.316+0000 7ff1fa000640 1 -- 172.21.15.2:0/2331780102 wait complete. 2024-05-14T15:16:20.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T15:15:42.977951+0000', 'modified': '2024-05-14T15:16:08.184374+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6837/218190176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 218190176}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 218190176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4273, 'qdb_cluster': [4273]} 2024-05-14T15:16:20.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T15:16:20.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-14T15:16:21.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.038+0000 7fe9ffa00640 1 Processor -- start 2024-05-14T15:16:21.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.039+0000 7fe9ffa00640 1 -- start start 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.041+0000 7fe9ffa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9f8161420 0x7fe9f815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.041+0000 7fe9ffa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9f80cd9d0 0x7fe9f815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.041+0000 7fe9ffa00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f815e190 0x7fe9f8070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.041+0000 7fe9ffa00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f8161950 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.041+0000 7fe9ffa00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f815d7c0 con 0x7fe9f8161420 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.041+0000 7fe9ffa00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f806c820 con 0x7fe9f815e190 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9f80cd9d0 0x7fe9f815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9f80cd9d0 0x7fe9f815dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46378/0 (socket says 172.21.15.2:46378) 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 -- 172.21.15.2:0/897455750 learned_addr learned my addr 172.21.15.2:0/897455750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9fda00640 1 --2- 172.21.15.2:0/897455750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f815e190 0x7fe9f8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9fd000640 1 --2- 172.21.15.2:0/897455750 >> v2:172.21.15.156:3300/0 conn(0x7fe9f8161420 0x7fe9f815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 -- 172.21.15.2:0/897455750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f815e190 msgr2=0x7fe9f8070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/897455750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f815e190 0x7fe9f8070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 -- 172.21.15.2:0/897455750 >> v2:172.21.15.156:3300/0 conn(0x7fe9f8161420 msgr2=0x7fe9f815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/897455750 >> v2:172.21.15.156:3300/0 conn(0x7fe9f8161420 0x7fe9f815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.042+0000 7fe9f7e00640 1 -- 172.21.15.2:0/897455750 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f806cb00 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.043+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/897455750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f815dc50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8072cb0 tx=0x7fe9e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183ce6c62bb2a365 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.044+0000 7fe9f7400640 1 -- 172.21.15.2:0/897455750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4037070 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.044+0000 7fe9f7400640 1 -- 172.21.15.2:0/897455750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e4032440 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.044+0000 7fe9f7400640 1 -- 172.21.15.2:0/897455750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4032810 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 -- 172.21.15.2:0/897455750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 msgr2=0x7fe9f815dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/897455750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f815dc50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8072cb0 tx=0x7fe9e402a140 comp rx=0 tx=0).stop 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 -- 172.21.15.2:0/897455750 shutdown_connections 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/897455750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f815e190 0x7fe9f8070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/897455750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f815dc50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/897455750 >> v2:172.21.15.156:3300/0 conn(0x7fe9f8161420 0x7fe9f815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 -- 172.21.15.2:0/897455750 >> 172.21.15.2:0/897455750 conn(0x7fe9f80ce230 msgr2=0x7fe9f80ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 -- 172.21.15.2:0/897455750 shutdown_connections 2024-05-14T15:16:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.045+0000 7fe9ffa00640 1 -- 172.21.15.2:0/897455750 wait complete. 2024-05-14T15:16:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.047+0000 7fe9ffa00640 1 Processor -- start 2024-05-14T15:16:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.048+0000 7fe9ffa00640 1 -- start start 2024-05-14T15:16:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.049+0000 7fe9ffa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.049+0000 7fe9ffa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f815e190 0x7fe9f814fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.049+0000 7fe9ffa00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f8161420 0x7fe9f814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.049+0000 7fe9ffa00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80709c0 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.049+0000 7fe9ffa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80cf390 con 0x7fe9f815e190 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.049+0000 7fe9ffa00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f8070b40 con 0x7fe9f8161420 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f814e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46390/0 (socket says 172.21.15.2:46390) 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 -- 172.21.15.2:0/1194131223 learned_addr learned my addr 172.21.15.2:0/1194131223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f815e190 0x7fe9f814fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fda00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f8161420 0x7fe9f814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 -- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f8161420 msgr2=0x7fe9f814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f8161420 0x7fe9f814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 -- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f815e190 msgr2=0x7fe9f814fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f815e190 0x7fe9f814fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.050+0000 7fe9fd000640 1 -- 172.21.15.2:0/1194131223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f8156e30 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.051+0000 7fe9fd000640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f814e6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800d5d0 tx=0x7fe9e800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.051+0000 7fe9f4c00640 1 -- 172.21.15.2:0/1194131223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8004240 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.051+0000 7fe9f4c00640 1 -- 172.21.15.2:0/1194131223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e80043e0 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.051+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f80ae7c0 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.051+0000 7fe9f4c00640 1 -- 172.21.15.2:0/1194131223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8003830 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.051+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f81697f0 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.055+0000 7fe9f4c00640 1 -- 172.21.15.2:0/1194131223 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe9e80039d0 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.056+0000 7fe9f4c00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe9d80762d0 0x7fe9d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.056+0000 7fe9f4c00640 1 -- 172.21.15.2:0/1194131223 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe9e8097cb0 con 0x7fe9f80cd9d0 2024-05-14T15:16:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.056+0000 7fea06a69740 1 Processor -- start 2024-05-14T15:16:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.056+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe9d80762d0 0x7fe9d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.056+0000 7fea06a69740 1 -- start start 2024-05-14T15:16:21.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe9d80762d0 0x7fe9d80787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4034000 tx=0x7fe9e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c1083b0 0x56368c4d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fea06a69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 0x56368c4fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fea06a69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56368c437790 con 0x56368c110590 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56368c3dcf20 con 0x56368c131270 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x56368c433750 con 0x56368c1083b0 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fe9fda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 0x56368c4fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fe9fda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 0x56368c4fe350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46392/0 (socket says 172.21.15.2:46392) 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fe9fda00640 1 -- 172.21.15.2:0/2560871698 learned_addr learned my addr 172.21.15.2:0/2560871698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c1083b0 0x56368c4d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.058+0000 7fe9fd000640 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9fda00640 1 -- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c1083b0 msgr2=0x56368c4d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9fda00640 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c1083b0 0x56368c4d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9fda00640 1 -- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 msgr2=0x56368c4ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9fda00640 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9fda00640 1 -- 172.21.15.2:0/2560871698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368c1492d0 con 0x56368c110590 2024-05-14T15:16:21.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9fda00640 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 0x56368c4fe350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009fd0 tx=0x7fe9f00077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ba069ef729f409 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9ed600640 1 -- 172.21.15.2:0/2560871698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00147e0 con 0x56368c110590 2024-05-14T15:16:21.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9ed600640 1 -- 172.21.15.2:0/2560871698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f001a070 con 0x56368c110590 2024-05-14T15:16:21.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.059+0000 7fe9ed600640 1 -- 172.21.15.2:0/2560871698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0014b80 con 0x56368c110590 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 -- 172.21.15.2:0/2560871698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 msgr2=0x56368c4fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 0x56368c4fe350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009fd0 tx=0x7fe9f00077c0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 -- 172.21.15.2:0/2560871698 shutdown_connections 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c110590 0x56368c4fe350 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c1083b0 0x56368c4d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 --2- 172.21.15.2:0/2560871698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 -- 172.21.15.2:0/2560871698 >> 172.21.15.2:0/2560871698 conn(0x56368c1253c0 msgr2=0x56368c4d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.060+0000 7fea06a69740 1 -- 172.21.15.2:0/2560871698 shutdown_connections 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.061+0000 7fea06a69740 1 -- 172.21.15.2:0/2560871698 wait complete. 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.062+0000 7fea06a69740 1 -- start start 2024-05-14T15:16:21.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.062+0000 7fea06a69740 1 Processor -- start 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c4f1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c501940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56368c4fbdc0 con 0x56368c1083b0 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56368c3f09c0 con 0x56368c131270 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x56368c4ce970 con 0x56368c110590 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fea06a69740 10 client.0 _ll_register_callbacks cb 0x56368c3bd120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c4f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c4f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46400/0 (socket says 172.21.15.2:46400) 2024-05-14T15:16:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 -- 172.21.15.2:0/286371241 learned_addr learned my addr 172.21.15.2:0/286371241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 -- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 msgr2=0x56368c501940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c501940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fda00640 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 -- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 msgr2=0x56368c4f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.064+0000 7fe9fd000640 1 -- 172.21.15.2:0/286371241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56368c2136b0 con 0x56368c1083b0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fe9fd000640 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c4f1770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8095ea0 tx=0x7fe9e8060320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a43634e9373fc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fe9e2000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fe9e2000640 1 -- 172.21.15.2:0/286371241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8061240 con 0x56368c1083b0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fe9e2000640 1 -- 172.21.15.2:0/286371241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe9e805fda0 con 0x56368c1083b0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9f001a070 con 0x56368c1083b0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fe9e2000640 1 -- 172.21.15.2:0/286371241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fe9e8060b40 con 0x56368c1083b0 2024-05-14T15:16:21.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fea06a69740 10 client.4674 fetch_fsmap learned FSMap version 8 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56368c512d80 con 0x56368c1083b0 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.065+0000 7fe9e2000640 1 -- 172.21.15.2:0/286371241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f001a070 con 0x56368c1083b0 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fe9e2000640 1 -- 172.21.15.2:0/286371241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fe9e8013070 con 0x56368c1083b0 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fea06a69740 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fea06a69740 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fea06a69740 20 client.4674 populate_metadata read hostname 'smithi002' 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fea06a69740 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c0efe40 0x56368c4ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fea06a69740 4 client.4674 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 --> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56368c4453a0 con 0x56368c0efe40 2024-05-14T15:16:21.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.066+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c0efe40 0x56368c4ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.067+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c0efe40 0x56368c4ff600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace636b2c88be5a3 server_cookie=84e44269b7f982da in_seq=0 out_seq=0 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.067+0000 7fe9e2000640 10 client.4674 ms_handle_connect on v2:172.21.15.156:6836/218190176 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.069+0000 7fe9e2000640 1 -- 172.21.15.2:0/286371241 <== mds.0 v2:172.21.15.156:6836/218190176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56368c4453a0 con 0x56368c0efe40 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.069+0000 7fe9e2000640 10 client.4674 handle_command_reply: tid=0 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.069+0000 7fea06a69740 1 client.4674 shutdown 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 msgr2=0x56368c4f1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c4f1770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8095ea0 tx=0x7fe9e8060320 comp rx=0 tx=0).stop 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 shutdown_connections 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c0efe40 0x56368c4ff600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c4f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c501940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 --2- 172.21.15.2:0/286371241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c4f1770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fe9e2000640 0 client.4674 ms_handle_reset on v2:172.21.15.156:6836/218190176 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 >> 172.21.15.2:0/286371241 conn(0x56368c1253c0 msgr2=0x56368c4fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 shutdown_connections 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 1 -- 172.21.15.2:0/286371241 wait complete. 2024-05-14T15:16:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.070+0000 7fea06a69740 20 client.4674 trim_cache size 0 max 16384 2024-05-14T15:16:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.091+0000 7fea06a69740 1 Processor -- start 2024-05-14T15:16:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.091+0000 7fea06a69740 1 -- start start 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fea06a69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c510e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fea06a69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8203290 con 0x56368c1083b0 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80b0040 con 0x56368c131270 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f8202c40 con 0x56368c110590 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fe9fd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c510e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fe9fd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c510e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46412/0 (socket says 172.21.15.2:46412) 2024-05-14T15:16:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.093+0000 7fe9fd000640 1 -- 172.21.15.2:0/702922 learned_addr learned my addr 172.21.15.2:0/702922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fda00640 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fd000640 1 -- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 msgr2=0x56368c51c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fd000640 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fd000640 1 -- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 msgr2=0x56368c51cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fd000640 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fd000640 1 -- 172.21.15.2:0/702922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368c513080 con 0x56368c1083b0 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fda00640 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.094+0000 7fe9fd000640 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c510e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800d5a0 tx=0x7fe9e8076000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad301b49ade286e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.095+0000 7fe9ecc00640 1 -- 172.21.15.2:0/702922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8060490 con 0x56368c1083b0 2024-05-14T15:16:21.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.095+0000 7fe9ecc00640 1 -- 172.21.15.2:0/702922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e80692e0 con 0x56368c1083b0 2024-05-14T15:16:21.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.095+0000 7fe9ecc00640 1 -- 172.21.15.2:0/702922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e805ffe0 con 0x56368c1083b0 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 -- 172.21.15.2:0/702922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 msgr2=0x56368c510e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c510e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800d5a0 tx=0x7fe9e8076000 comp rx=0 tx=0).stop 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 -- 172.21.15.2:0/702922 shutdown_connections 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 --2- 172.21.15.2:0/702922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c1083b0 0x56368c510e20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 -- 172.21.15.2:0/702922 >> 172.21.15.2:0/702922 conn(0x56368c1253c0 msgr2=0x56368c4d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 -- 172.21.15.2:0/702922 shutdown_connections 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.096+0000 7fea06a69740 1 -- 172.21.15.2:0/702922 wait complete. 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.097+0000 7fea06a69740 1 -- start start 2024-05-14T15:16:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.097+0000 7fea06a69740 1 Processor -- start 2024-05-14T15:16:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c1083b0 0x56368c595cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56368c4e3bf0 con 0x56368c131270 2024-05-14T15:16:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56368c4f2ef0 con 0x56368c1083b0 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x56368c501fe0 con 0x56368c110590 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fea06a69740 10 client.0 _ll_register_callbacks cb 0x7fe9e8006eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fe9fda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fe9fda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46418/0 (socket says 172.21.15.2:46418) 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fe9fda00640 1 -- 172.21.15.2:0/2299216361 learned_addr learned my addr 172.21.15.2:0/2299216361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fe9f7e00640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.099+0000 7fe9fd000640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c1083b0 0x56368c595cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9fda00640 1 -- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 msgr2=0x56368c51c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9fda00640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9fda00640 1 -- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c1083b0 msgr2=0x56368c595cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9fda00640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c1083b0 0x56368c595cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9fda00640 1 -- 172.21.15.2:0/2299216361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56368c53bdc0 con 0x56368c131270 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9fda00640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 0x56368c51cb80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0000f80 tx=0x7fe9f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba44cc6b0c874f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9e2000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9e2000640 1 -- 172.21.15.2:0/2299216361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f002e060 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fe9e2000640 1 -- 172.21.15.2:0/2299216361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe9f0014da0 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.100+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56368c43f210 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fe9e2000640 1 -- 172.21.15.2:0/2299216361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fe9f0034050 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 10 client.4680 fetch_fsmap learned FSMap version 8 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56368c596770 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fe9e2000640 1 -- 172.21.15.2:0/2299216361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56368c43f210 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fe9e2000640 1 -- 172.21.15.2:0/2299216361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fe9f0037020 con 0x56368c131270 2024-05-14T15:16:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2024-05-14T15:16:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:16:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 20 client.4680 populate_metadata read hostname 'smithi002' 2024-05-14T15:16:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c4fe8b0 0x56368c50eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 4 client.4680 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:16:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.101+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 --> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] -- command(tid 0: {"prefix": "status"}) -- 0x56368c3ba860 con 0x56368c4fe8b0 2024-05-14T15:16:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.102+0000 7fe9fd000640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c4fe8b0 0x56368c50eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.103+0000 7fe9fd000640 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c4fe8b0 0x56368c50eaf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c88e176eb22fef server_cookie=d90f878430d968f1 in_seq=0 out_seq=0 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.103+0000 7fe9e2000640 10 client.4680 ms_handle_connect on v2:172.21.15.156:6836/218190176 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fe9e2000640 1 -- 172.21.15.2:0/2299216361 <== mds.0 v2:172.21.15.156:6836/218190176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56368c3ba860 con 0x56368c4fe8b0 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fe9e2000640 10 client.4680 handle_command_reply: tid=0 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 client.4680 shutdown 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 msgr2=0x56368c51cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 0x56368c51cb80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0000f80 tx=0x7fe9f0012000 comp rx=0 tx=0).stop 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 shutdown_connections 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:6836/218190176,v1:172.21.15.156:6837/218190176] conn(0x56368c4fe8b0 0x56368c50eaf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56368c131270 0x56368c51cb80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x56368c110590 0x56368c51c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 --2- 172.21.15.2:0/2299216361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56368c1083b0 0x56368c595cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fe9e2000640 0 client.4680 ms_handle_reset on v2:172.21.15.156:6836/218190176 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 >> 172.21.15.2:0/2299216361 conn(0x56368c1253c0 msgr2=0x56368c4fafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 shutdown_connections 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 1 -- 172.21.15.2:0/2299216361 wait complete. 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.104+0000 7fea06a69740 20 client.4680 trim_cache size 0 max 16384 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c9147305-965e-4a8b-a03b-3f802813a40c", 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4273, 2024-05-14T15:16:21.106 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 37.666253163, 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 8, 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 26, 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 26, 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 44.337735719000001 2024-05-14T15:16:21.107 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe9d80762d0 msgr2=0x7fe9d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe9d80762d0 0x7fe9d80787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4034000 tx=0x7fe9e402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 msgr2=0x7fe9f814e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f814e6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800d5d0 tx=0x7fe9e800da90 comp rx=0 tx=0).stop 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 shutdown_connections 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe9d80762d0 0x7fe9d80787e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f815e190 0x7fe9f814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f8161420 0x7fe9f814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 --2- 172.21.15.2:0/1194131223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f80cd9d0 0x7fe9f814e6b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 >> 172.21.15.2:0/1194131223 conn(0x7fe9f80ce230 msgr2=0x7fe9f8160980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 shutdown_connections 2024-05-14T15:16:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.105+0000 7fe9ffa00640 1 -- 172.21.15.2:0/1194131223 wait complete. 2024-05-14T15:16:21.131 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T15:16:21.142 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T15:16:21.142 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T15:16:21.142 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T15:16:21.143 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-14T15:16:21.181 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-14T15:16:21.181 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-14T15:16:21.181 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-14T15:16:21.181 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:21.182 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:21.182 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:21.182 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:16:21.182 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:21.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:21.183 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-05-14T15:16:21.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:21.243 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2024-05-14T15:16:21.333 INFO:teuthology.orchestra.run.smithi156.stderr:Cannot find device "ceph-brx" 2024-05-14T15:16:21.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:16:21.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:21.337 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-05-14T15:16:21.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-14T15:16:21.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:21.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:16:21.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:21.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-05-14T15:16:21.608 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-14T15:16:21.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T15:16:21.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.864+0000 7f152a400640 1 Processor -- start 2024-05-14T15:16:21.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.864+0000 7f152a400640 1 -- start start 2024-05-14T15:16:21.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.867+0000 7f152a400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1524071530 0x7f15240af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.867+0000 7f152a400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 0x7f152406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.867+0000 7f152a400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15240d1460 con 0x7f152415bb90 2024-05-14T15:16:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.867+0000 7f152a400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f152415eb50 con 0x7f152406d700 2024-05-14T15:16:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.867+0000 7f152a400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f152415f350 con 0x7f1524071530 2024-05-14T15:16:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.868+0000 7f1523e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 0x7f152406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.868+0000 7f1523e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 0x7f152406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:53230/0 (socket says 172.21.15.2:53230) 2024-05-14T15:16:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.868+0000 7f1523e00640 1 -- 172.21.15.2:0/3784989717 learned_addr learned my addr 172.21.15.2:0/3784989717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.868+0000 7f1522a00640 1 --2- 172.21.15.2:0/3784989717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1524071530 0x7f15240af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1522000640 1 -- 172.21.15.2:0/3784989717 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237164262 0 0) 0x7f15240d1460 con 0x7f152415bb90 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1522000640 1 -- 172.21.15.2:0/3784989717 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1508003520 con 0x7f152415bb90 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1522a00640 1 -- 172.21.15.2:0/3784989717 >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 msgr2=0x7f152406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1522a00640 1 --2- 172.21.15.2:0/3784989717 >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 0x7f152406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1522a00640 1 -- 172.21.15.2:0/3784989717 >> v1:172.21.15.156:6789/0 conn(0x7f152415bb90 legacy=0x7f152415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1522a00640 1 -- 172.21.15.2:0/3784989717 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152406e050 con 0x7f1524071530 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.869+0000 7f1523e00640 1 --2- 172.21.15.2:0/3784989717 >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 0x7f152406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.870+0000 7f1522a00640 1 --2- 172.21.15.2:0/3784989717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1524071530 0x7f15240af080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15100097a0 tx=0x7f151002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3612039bd90e99db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.871+0000 7f1522000640 1 -- 172.21.15.2:0/3784989717 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510037070 con 0x7f1524071530 2024-05-14T15:16:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.871+0000 7f1522000640 1 -- 172.21.15.2:0/3784989717 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151002ae50 con 0x7f1524071530 2024-05-14T15:16:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.871+0000 7f1522000640 1 -- 172.21.15.2:0/3784989717 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510032660 con 0x7f1524071530 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 -- 172.21.15.2:0/3784989717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1524071530 msgr2=0x7f15240af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 --2- 172.21.15.2:0/3784989717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1524071530 0x7f15240af080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15100097a0 tx=0x7f151002a100 comp rx=0 tx=0).stop 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 -- 172.21.15.2:0/3784989717 shutdown_connections 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 --2- 172.21.15.2:0/3784989717 >> v2:172.21.15.156:3300/0 conn(0x7f152406d700 0x7f152406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 --2- 172.21.15.2:0/3784989717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1524071530 0x7f15240af080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 -- 172.21.15.2:0/3784989717 >> 172.21.15.2:0/3784989717 conn(0x7f15240d1d10 msgr2=0x7f15240734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 -- 172.21.15.2:0/3784989717 shutdown_connections 2024-05-14T15:16:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.872+0000 7f152a400640 1 -- 172.21.15.2:0/3784989717 wait complete. 2024-05-14T15:16:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.875+0000 7f152a400640 1 Processor -- start 2024-05-14T15:16:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.875+0000 7f152a400640 1 -- start start 2024-05-14T15:16:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.876+0000 7f152a400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 0x7f15240c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.876+0000 7f152a400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1524071530 0x7f1524154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.876+0000 7f152a400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f152415bb90 0x7f15241f9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.876+0000 7f152a400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15240ae880 con 0x7f152406d700 2024-05-14T15:16:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.876+0000 7f152a400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f152415f070 con 0x7f1524071530 2024-05-14T15:16:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.876+0000 7f152a400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f15240aeb60 con 0x7f152415bb90 2024-05-14T15:16:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 0x7f15240c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 0x7f15240c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46422/0 (socket says 172.21.15.2:46422) 2024-05-14T15:16:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 -- 172.21.15.2:0/3427923674 learned_addr learned my addr 172.21.15.2:0/3427923674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1522a00640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1524071530 0x7f1524154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 -- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f152415bb90 msgr2=0x7f15241f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f152415bb90 0x7f15241f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 -- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1524071530 msgr2=0x7f1524154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1524071530 0x7f1524154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.877+0000 7f1523400640 1 -- 172.21.15.2:0/3427923674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1524154ca0 con 0x7f152406d700 2024-05-14T15:16:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.878+0000 7f1523400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 0x7f15240c8f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f151400c3c0 tx=0x7f151400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.878+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514017070 con 0x7f152406d700 2024-05-14T15:16:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.878+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15140052d0 con 0x7f152406d700 2024-05-14T15:16:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.878+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514003830 con 0x7f152406d700 2024-05-14T15:16:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.878+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1524150df0 con 0x7f152406d700 2024-05-14T15:16:21.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.878+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241513b0 con 0x7f152406d700 2024-05-14T15:16:21.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.879+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1524050870 con 0x7f152406d700 2024-05-14T15:16:21.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.881+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f151401a070 con 0x7f152406d700 2024-05-14T15:16:21.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.882+0000 7f151b400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1504076300 0x7f1504078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:21.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.882+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1514096d30 con 0x7f152406d700 2024-05-14T15:16:21.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.882+0000 7f1522a00640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1504076300 0x7f1504078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:21.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.884+0000 7f1522a00640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1504076300 0x7f1504078810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1510034000 tx=0x7f151002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:21.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:21.888+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1514060220 con 0x7f152406d700 2024-05-14T15:16:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.140+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f15240c9650 con 0x7f152406d700 2024-05-14T15:16:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.141+0000 7f151b400640 1 -- 172.21.15.2:0/3427923674 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f15140682a0 con 0x7f152406d700 2024-05-14T15:16:22.140 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1504076300 msgr2=0x7f1504078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1504076300 0x7f1504078810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1510034000 tx=0x7f151002e000 comp rx=0 tx=0).stop 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 msgr2=0x7f15240c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 0x7f15240c8f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f151400c3c0 tx=0x7f151400c880 comp rx=0 tx=0).stop 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 shutdown_connections 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1504076300 0x7f1504078810 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1524071530 0x7f1524154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f152415bb90 0x7f15241f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 --2- 172.21.15.2:0/3427923674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152406d700 0x7f15240c8f00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 >> 172.21.15.2:0/3427923674 conn(0x7f15240d1d10 msgr2=0x7f15240afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 shutdown_connections 2024-05-14T15:16:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22.144+0000 7f152a400640 1 -- 172.21.15.2:0/3427923674 wait complete. 2024-05-14T15:16:22.168 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T15:16:22.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:16:22.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-05-14T15:16:22.168 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T15:16:22.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:22.169 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T15:16:22.169 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:16:22.169 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:16:22.169 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T15:16:22.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:22.169 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-05-14T15:16:22.222 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:22.222 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:22.223 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:22.224 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:22.225 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-05-14T15:16:22.225 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T15:16:22.225 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:22.225 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:22.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-05-14T15:16:22.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-05-14T15:16:22.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-05-14T15:16:22.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T15:16:22.226 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:22.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:22.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:22.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:22.493 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:16:22.560 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-05-14T15:16:22.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:22.564 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-05-14T15:16:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-05-14T15:16:22.611 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:16:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T15:16:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T15:16:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:16:22.612 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:22.612 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:22.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T15:16:22.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T15:16:22.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T15:16:22.612 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:22.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:22.834 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-05-14T15:16:22.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:22.888 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-05-14T15:16:22.941 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:22.941 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:22.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:22.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-14T15:16:22.941 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:23.131 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-14T15:16:23.131 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:23.131 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:23.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-14T15:16:23.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T15:16:23.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-14T15:16:23.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-14T15:16:23.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-14T15:16:23.132 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:23.412 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:23.412 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:23.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-05-14T15:16:23.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T15:16:23.412 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:23.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:23.626 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-14T15:16:23.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:23.627 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T15:16:23.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:23.673 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:23.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:16:23.846 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:23.897 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:16:23.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:16:23.897 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:16:23.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:16:23.897 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:16:23.897 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:16:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:23.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:23.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:23.901 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:16:23.950 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T15:16:23.950 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-14T15:16:23.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:16:24.021 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:24.061 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:24.062 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:16:24.063 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:16:24.064 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:16:24.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:16:24.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:24.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:24.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:24.065 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:16:24.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2024-05-14T15:16:24.197+0000 7f56eeaf1480 -1 init, newargv = 0x7f56d0056020 newargc=15 2024-05-14T15:16:24.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[44261]: starting ceph client 2024-05-14T15:16:24.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[44261]: starting fuse 2024-05-14T15:16:25.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:16:25.317 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:25.359 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:16:25.360 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:16:25.361 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:25.362 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:25.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:25.363 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:16:25.459 INFO:teuthology.orchestra.run.smithi002.stdout:40 2024-05-14T15:16:25.459 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-14T15:16:25.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:16:25.459 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-05-14T15:16:25.459 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-05-14T15:16:25.459 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-05-14T15:16:25.459 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-05-14T15:16:25.460 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2024-05-14T15:16:25.461 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-05-14T15:16:25.646 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.44261.asok 2024-05-14T15:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:25.665 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44261.asok 2024-05-14T15:16:25.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:25.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44261.asok status 2024-05-14T15:16:25.968 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:16:25.968 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "44261", 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4692, 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-05-14T15:16:25.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4692 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2492549456 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2492549456 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:25.970 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4692 192.168.0.1:0/2492549456", 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/2492549456", 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 8, 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 26, 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-05-14T15:16:25.971 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:16:25.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T15:16:26.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.268+0000 7f17d3000640 1 Processor -- start 2024-05-14T15:16:26.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.268+0000 7f17d3000640 1 -- start start 2024-05-14T15:16:26.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.270+0000 7f17d3000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f17cc071530 0x7f17cc0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.270+0000 7f17d3000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17cc0d1460 con 0x7f17cc06d700 2024-05-14T15:16:26.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.270+0000 7f17d3000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17cc15ed90 con 0x7f17cc15bb90 2024-05-14T15:16:26.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.270+0000 7f17d3000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f17cc15eb50 con 0x7f17cc071530 2024-05-14T15:16:26.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.271+0000 7f17d1000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f17cc06d700 0x7f17cc06db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55172/0 (socket says 172.21.15.2:55172) 2024-05-14T15:16:26.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.271+0000 7f17d1000640 1 -- 172.21.15.2:0/1375430683 learned_addr learned my addr 172.21.15.2:0/1375430683 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:26.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.271+0000 7f17cb400640 1 --2- 172.21.15.2:0/1375430683 >> v2:172.21.15.156:3300/0 conn(0x7f17cc071530 0x7f17cc0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351398004 0 0) 0x7f17cc0d1460 con 0x7f17cc06d700 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17b0003520 con 0x7f17cc06d700 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208966871 0 0) 0x7f17cc15ed90 con 0x7f17cc15bb90 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17cc0d1460 con 0x7f17cc15bb90 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2382785702 0 0) 0x7f17b0003520 con 0x7f17cc06d700 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 >> v2:172.21.15.156:3300/0 conn(0x7f17cc071530 msgr2=0x7f17cc0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 --2- 172.21.15.2:0/1375430683 >> v2:172.21.15.156:3300/0 conn(0x7f17cc071530 0x7f17cc0af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 >> v1:172.21.15.156:6789/0 conn(0x7f17cc15bb90 legacy=0x7f17cc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc15f070 con 0x7f17cc06d700 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f17c40016f0 con 0x7f17cc06d700 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 >> v1:172.21.15.2:6789/0 conn(0x7f17cc06d700 legacy=0x7f17cc06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b0003c30 0x7f17b0004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0004800 0x7f17b0004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17b00053c0 0x7f17b000ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc15eb50 con 0x7f17b0003c30 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f17b000c350 con 0x7f17b0004800 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f17b000c550 con 0x7f17b00053c0 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.272+0000 7f17cb400640 1 --2- 172.21.15.2:0/1375430683 >> v2:172.21.15.156:3300/0 conn(0x7f17cc071530 0x7f17cc0af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b0003c30 0x7f17b0004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cb400640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0004800 0x7f17b0004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17d1000640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17b00053c0 0x7f17b000ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cbe00640 1 -- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17b00053c0 msgr2=0x7f17b000ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17b00053c0 0x7f17b000ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cbe00640 1 -- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0004800 msgr2=0x7f17b0004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0004800 0x7f17b0004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17cbe00640 1 -- 172.21.15.2:0/1375430683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b0003520 con 0x7f17b0003c30 2024-05-14T15:16:26.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.273+0000 7f17d1000640 1 -- 172.21.15.2:0/1375430683 reap_dead start 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.274+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b0003c30 0x7f17b0004080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001fd0 tx=0x7f17b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0786aa4a51127 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.275+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc001c20 con 0x7f17b0003c30 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.275+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc006d70 con 0x7f17b0003c30 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.275+0000 7f17caa00640 1 -- 172.21.15.2:0/1375430683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc003bb0 con 0x7f17b0003c30 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 -- 172.21.15.2:0/1375430683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b0003c30 msgr2=0x7f17b0004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b0003c30 0x7f17b0004080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001fd0 tx=0x7f17b0005830 comp rx=0 tx=0).stop 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 -- 172.21.15.2:0/1375430683 shutdown_connections 2024-05-14T15:16:26.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 --2- 172.21.15.2:0/1375430683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17b0003c30 0x7f17b0004080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 -- 172.21.15.2:0/1375430683 >> 172.21.15.2:0/1375430683 conn(0x7f17cc0d1d10 msgr2=0x7f17cc0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:26.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 -- 172.21.15.2:0/1375430683 shutdown_connections 2024-05-14T15:16:26.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.276+0000 7f17d3000640 1 -- 172.21.15.2:0/1375430683 wait complete. 2024-05-14T15:16:26.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.279+0000 7f17d3000640 1 Processor -- start 2024-05-14T15:16:26.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.279+0000 7f17d3000640 1 -- start start 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.280+0000 7f17d3000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0003c30 0x7f17cc153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17d3000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 0x7f17cc153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17d3000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17cc0cf820 0x7f17cc0cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17d3000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc0aeb60 con 0x7f17cc158a80 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17d3000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc15f350 con 0x7f17b0003c30 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17d3000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f17cc15e440 con 0x7f17cc0cf820 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 0x7f17cc153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 0x7f17cc153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46442/0 (socket says 172.21.15.2:46442) 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 -- 172.21.15.2:0/1780470947 learned_addr learned my addr 172.21.15.2:0/1780470947 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0003c30 0x7f17cc153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17d1000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17cc0cf820 0x7f17cc0cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 -- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17cc0cf820 msgr2=0x7f17cc0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17cc0cf820 0x7f17cc0cfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 -- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0003c30 msgr2=0x7f17cc153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0003c30 0x7f17cc153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.281+0000 7f17cb400640 1 -- 172.21.15.2:0/1780470947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc0ce780 con 0x7f17cc158a80 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.282+0000 7f17cb400640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 0x7f17cc153410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17b4011900 tx=0x7f17b4011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.282+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b400fbd0 con 0x7f17cc158a80 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.282+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b400fd70 con 0x7f17cc158a80 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.282+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40156a0 con 0x7f17cc158a80 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.282+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc0cea60 con 0x7f17cc158a80 2024-05-14T15:16:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.282+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc0cf020 con 0x7f17cc158a80 2024-05-14T15:16:26.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.283+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc050870 con 0x7f17cc158a80 2024-05-14T15:16:26.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.285+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17b4015840 con 0x7f17cc158a80 2024-05-14T15:16:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.286+0000 7f17c3e00640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17a80762d0 0x7f17a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:26.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.286+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f17b4098590 con 0x7f17cc158a80 2024-05-14T15:16:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.287+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17a80762d0 0x7f17a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:26.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.288+0000 7f17cbe00640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17a80762d0 0x7f17a80787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17bc031000 tx=0x7f17bc009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:26.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.292+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17b4019030 con 0x7f17cc158a80 2024-05-14T15:16:26.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.551+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17cc06de90 con 0x7f17cc158a80 2024-05-14T15:16:26.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.552+0000 7f17c3e00640 1 -- 172.21.15.2:0/1780470947 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f17b4061b10 con 0x7f17cc158a80 2024-05-14T15:16:26.550 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:16:26.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.554+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17a80762d0 msgr2=0x7f17a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.554+0000 7f17d3000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17a80762d0 0x7f17a80787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17bc031000 tx=0x7f17bc009030 comp rx=0 tx=0).stop 2024-05-14T15:16:26.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.554+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 msgr2=0x7f17cc153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:26.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.554+0000 7f17d3000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 0x7f17cc153410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17b4011900 tx=0x7f17b4011dc0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 shutdown_connections 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17a80762d0 0x7f17a80787e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17cc0cf820 0x7f17cc0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc158a80 0x7f17cc153410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 --2- 172.21.15.2:0/1780470947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b0003c30 0x7f17cc153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 >> 172.21.15.2:0/1780470947 conn(0x7f17cc0d1d10 msgr2=0x7f17cc0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 shutdown_connections 2024-05-14T15:16:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26.555+0000 7f17d3000640 1 -- 172.21.15.2:0/1780470947 wait complete. 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:16:26.579 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-14T15:16:26.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:26.580 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-05-14T15:16:26.630 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:26.631 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 82:3a:42:e2:14:84 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5818:95ff:fe1f:331f/64 scope link 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T15:16:26.632 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 82:3a:42:e2:14:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:26.633 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::803a:42ff:fee2:1484/64 scope link 2024-05-14T15:16:26.633 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:26.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:26.633 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:16:26.711 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-05-14T15:16:26.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:26.715 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-05-14T15:16:26.773 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-05-14T15:16:26.773 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:16:26.773 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T15:16:26.773 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T15:16:26.773 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:16:26.773 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:26.773 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:26.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T15:16:26.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T15:16:26.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T15:16:26.774 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:26.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:26.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:26.998 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-05-14T15:16:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T15:16:27.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:27.052 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-05-14T15:16:27.105 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-14T15:16:27.107 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:27.107 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:27.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:27.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-14T15:16:27.107 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:27.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:27.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-14T15:16:27.381 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:27.381 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:27.381 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 86:08:67:ba:b6:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::8408:67ff:feba:b699/64 scope link 2024-05-14T15:16:27.382 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:27.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-14T15:16:27.478 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 86:08:67:ba:b6:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::8408:67ff:feba:b699/64 scope link 2024-05-14T15:16:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:27.485 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-14T15:16:27.485 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:27.485 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:27.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-14T15:16:27.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-14T15:16:27.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-14T15:16:27.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-14T15:16:27.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-14T15:16:27.486 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:27.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:27.764 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:27.764 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:16:27.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2024-05-14T15:16:27.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2024-05-14T15:16:27.764 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:16:27.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:27.966 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-14T15:16:27.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:27.966 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:28.015 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-14T15:16:28.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:28.015 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:28.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:16:28.153 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:28.212 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:16:28.212 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:16:28.212 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:16:28.212 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:16:28.212 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:28.213 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:28.214 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:28.215 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:28.215 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:28.215 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:28.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:28.216 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:16:28.270 INFO:teuthology.orchestra.run.smithi002.stdout:40 2024-05-14T15:16:28.270 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-05-14T15:16:28.270 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-14T15:16:28.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:16:28.347 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:16:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:28.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:28.400 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:16:28.460 INFO:teuthology.orchestra.run.smithi002.stdout:40 2024-05-14T15:16:28.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:2024-05-14T15:16:28.527+0000 7f50a008d480 -1 init, newargv = 0x7f50840057c0 newargc=15 2024-05-14T15:16:28.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[44838]: starting ceph client 2024-05-14T15:16:28.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[44838]: starting fuse 2024-05-14T15:16:29.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:16:29.660 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:16:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:16:29.719 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:29.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:29.720 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:16:29.778 INFO:teuthology.orchestra.run.smithi002.stdout:40 2024-05-14T15:16:29.778 INFO:teuthology.orchestra.run.smithi002.stdout:43 2024-05-14T15:16:29.778 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-05-14T15:16:29.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:16:29.778 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-05-14T15:16:29.778 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-05-14T15:16:29.778 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:16:29.779 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.2")) 2024-05-14T15:16:29.780 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-05-14T15:16:29.955 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.2.44838.asok 2024-05-14T15:16:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:29.976 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44838.asok 2024-05-14T15:16:29.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:29.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44838.asok status 2024-05-14T15:16:30.286 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:16:30.286 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "2", 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "44838", 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-05-14T15:16:30.287 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4707, 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4707 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.2:0", 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3112853076 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:16:30.288 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.2:0", 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3112853076 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4707 192.168.0.2:0/3112853076", 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.2:0/3112853076", 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 8, 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 26, 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-05-14T15:16:30.289 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:16:30.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T15:16:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.585+0000 7f26e9600640 1 Processor -- start 2024-05-14T15:16:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.585+0000 7f26e9600640 1 -- start start 2024-05-14T15:16:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e9600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f26e406d700 0x7f26e406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e9600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 0x7f26e40aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e9600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e406e050 con 0x7f26e40d1050 2024-05-14T15:16:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e9600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f26e41624e0 con 0x7f26e406d700 2024-05-14T15:16:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e9600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f26e41618d0 con 0x7f26e40ae750 2024-05-14T15:16:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f26e40d1050 0x7f26e4070940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36882/0 (socket says 172.21.15.2:36882) 2024-05-14T15:16:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.588+0000 7f26e3e00640 1 -- 172.21.15.2:0/2001953242 learned_addr learned my addr 172.21.15.2:0/2001953242 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e3400640 1 --2- 172.21.15.2:0/2001953242 >> v2:172.21.15.156:3300/0 conn(0x7f26e406d700 0x7f26e406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e8c00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 0x7f26e40aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889468249 0 0) 0x7f26d4001110 con 0x7f26e40d1050 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c8003520 con 0x7f26e40d1050 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3907266564 0 0) 0x7f26c8003520 con 0x7f26e40d1050 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 msgr2=0x7f26e40aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 0x7f26e40aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 >> v2:172.21.15.156:3300/0 conn(0x7f26e406d700 msgr2=0x7f26e406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 --2- 172.21.15.2:0/2001953242 >> v2:172.21.15.156:3300/0 conn(0x7f26e406d700 0x7f26e406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e4161bb0 con 0x7f26e40d1050 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f26d40018c0 con 0x7f26e40d1050 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 >> v1:172.21.15.2:6789/0 conn(0x7f26e40d1050 legacy=0x7f26e4070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c8003a00 0x7f26c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26c8004800 0x7f26c8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.589+0000 7f26e2a00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 0x7f26c8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41624e0 con 0x7f26c8003a00 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41618d0 con 0x7f26c8004800 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f26c800ba70 con 0x7f26e40ae750 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3e00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c8003a00 0x7f26c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3400640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26c8004800 0x7f26c8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e8c00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 0x7f26c8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3e00640 1 -- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 msgr2=0x7f26c8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3e00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e40ae750 0x7f26c8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3e00640 1 -- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26c8004800 msgr2=0x7f26c8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3e00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26c8004800 0x7f26c8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.590+0000 7f26e3e00640 1 -- 172.21.15.2:0/2001953242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c8003520 con 0x7f26c8003a00 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.592+0000 7f26e3e00640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c8003a00 0x7f26c8003e70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26e40b3320 tx=0x7f26c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74906d0d198eec91 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.592+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d400c0e0 con 0x7f26c8003a00 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.592+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d4005ad0 con 0x7f26c8003a00 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.592+0000 7f26e2a00640 1 -- 172.21.15.2:0/2001953242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4007070 con 0x7f26c8003a00 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e9600640 1 -- 172.21.15.2:0/2001953242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c8003a00 msgr2=0x7f26c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e9600640 1 --2- 172.21.15.2:0/2001953242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26c8003a00 0x7f26c8003e70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26e40b3320 tx=0x7f26c8005830 comp rx=0 tx=0).stop 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e8c00640 1 -- 172.21.15.2:0/2001953242 reap_dead start 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e9600640 1 -- 172.21.15.2:0/2001953242 shutdown_connections 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e9600640 1 -- 172.21.15.2:0/2001953242 >> 172.21.15.2:0/2001953242 conn(0x7f26e40732e0 msgr2=0x7f26e40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e9600640 1 -- 172.21.15.2:0/2001953242 shutdown_connections 2024-05-14T15:16:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.593+0000 7f26e9600640 1 -- 172.21.15.2:0/2001953242 wait complete. 2024-05-14T15:16:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.595+0000 7f26e9600640 1 Processor -- start 2024-05-14T15:16:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.596+0000 7f26e9600640 1 -- start start 2024-05-14T15:16:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e9600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e41539c0 0x7f26e4151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e9600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e41f5110 0x7f26e41e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 0x7f26e4152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e9600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4071050 con 0x7f26e41e7c70 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e9600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4162170 con 0x7f26e41539c0 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e9600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f26e415f110 con 0x7f26e41f5110 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.597+0000 7f26e8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 0x7f26e4152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 0x7f26e4152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49076/0 (socket says 172.21.15.2:49076) 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 -- 172.21.15.2:0/229182669 learned_addr learned my addr 172.21.15.2:0/229182669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e3e00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e41539c0 0x7f26e4151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e3400640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e41f5110 0x7f26e41e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 -- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e41f5110 msgr2=0x7f26e41e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e41f5110 0x7f26e41e7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 -- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e41539c0 msgr2=0x7f26e4151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e41539c0 0x7f26e4151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 -- 172.21.15.2:0/229182669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e4153f80 con 0x7f26e41e7c70 2024-05-14T15:16:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.598+0000 7f26e8c00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 0x7f26e4152e50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f26e4073270 tx=0x7f26dc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.599+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc003990 con 0x7f26e41e7c70 2024-05-14T15:16:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.599+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc01b070 con 0x7f26e41e7c70 2024-05-14T15:16:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.599+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc003b70 con 0x7f26e41e7c70 2024-05-14T15:16:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.599+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e4154260 con 0x7f26e41e7c70 2024-05-14T15:16:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.599+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e4154820 con 0x7f26e41e7c70 2024-05-14T15:16:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.600+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e4050870 con 0x7f26e41e7c70 2024-05-14T15:16:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.601+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f26dc005d10 con 0x7f26e41e7c70 2024-05-14T15:16:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.602+0000 7f26dbe00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f26c4076300 0x7f26c4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.603+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f26dc098090 con 0x7f26e41e7c70 2024-05-14T15:16:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.603+0000 7f26e3e00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f26c4076300 0x7f26c4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.605+0000 7f26e3e00640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f26c4076300 0x7f26c4078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26d4033000 tx=0x7f26d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.608+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f26dc025020 con 0x7f26e41e7c70 2024-05-14T15:16:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.867+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f26e4074450 con 0x7f26e41e7c70 2024-05-14T15:16:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.868+0000 7f26dbe00640 1 -- 172.21.15.2:0/229182669 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f26dc0615e0 con 0x7f26e41e7c70 2024-05-14T15:16:30.867 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:16:30.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f26c4076300 msgr2=0x7f26c4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f26c4076300 0x7f26c4078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26d4033000 tx=0x7f26d402e000 comp rx=0 tx=0).stop 2024-05-14T15:16:30.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 msgr2=0x7f26e4152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 0x7f26e4152e50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f26e4073270 tx=0x7f26dc0115a0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 shutdown_connections 2024-05-14T15:16:30.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f26c4076300 0x7f26c4078810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e41e7c70 0x7f26e4152e50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26e41f5110 0x7f26e41e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 --2- 172.21.15.2:0/229182669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e41539c0 0x7f26e4151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.871+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 >> 172.21.15.2:0/229182669 conn(0x7f26e40732e0 msgr2=0x7f26e40b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:30.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.872+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 shutdown_connections 2024-05-14T15:16:30.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:30.872+0000 7f26e9600640 1 -- 172.21.15.2:0/229182669 wait complete. 2024-05-14T15:16:30.894 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi156.front.sepia.ceph.com 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:16:30.895 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-14T15:16:30.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:30.895 DEBUG:teuthology.orchestra.run.smithi156:> ip addr 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:30.952 INFO:teuthology.orchestra.run.smithi156.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c0 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f0 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c1 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f1 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fc brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fd brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.21.15.156/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft 42538sec preferred_lft 42538sec 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec4:7aff:fe88:6dfd/64 scope link 2024-05-14T15:16:30.953 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:30.954 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add name ceph-brx type bridge 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr flush dev ceph-brx 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set ceph-brx up 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T15:16:30.955 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:31.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:31.413 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:31.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:31.422 DEBUG:teuthology.orchestra.run.smithi156:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:16:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:1 2024-05-14T15:16:31.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:31.492 DEBUG:teuthology.orchestra.run.smithi156:> route 2024-05-14T15:16:31.539 INFO:teuthology.orchestra.run.smithi156.stdout:Kernel IP routing table 2024-05-14T15:16:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:16:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T15:16:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T15:16:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:16:31.540 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:31.540 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:31.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T15:16:31.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T15:16:31.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T15:16:31.540 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:31.636 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:32.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:32.257 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-05-14T15:16:32.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:32.302 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list-id 2024-05-14T15:16:32.393 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:32.393 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:32.393 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:32.393 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-14T15:16:32.393 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:32.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:32.550 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-14T15:16:32.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-14T15:16:32.551 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:32.642 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:32.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:32.825 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:32.825 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:32.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set brx.0 up 2024-05-14T15:16:32.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T15:16:32.825 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:32.911 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:33.005 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:33.014 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-14T15:16:33.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:33.014 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-14T15:16:33.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:33.053 DEBUG:teuthology.orchestra.run.smithi156:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:33.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo modprobe fuse 2024-05-14T15:16:33.220 DEBUG:teuthology.orchestra.run.smithi156:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:/proc 2024-05-14T15:16:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:/sys 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/dev 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/security 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/shm 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/pts 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/run 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/cgroup 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/pstore 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/bpf 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/ 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/selinux 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/hugepages 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/mqueue 2024-05-14T15:16:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/debug 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/tracing 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/config 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/run/user/1000 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T15:16:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns 2024-05-14T15:16:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:33.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:33.272 DEBUG:teuthology.orchestra.run.smithi156:> ls /sys/fs/fuse/connections 2024-05-14T15:16:33.316 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T15:16:33.316 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-14T15:16:33.363 DEBUG:teuthology.orchestra.run.smithi156:> sudo modprobe fuse 2024-05-14T15:16:33.435 DEBUG:teuthology.orchestra.run.smithi156:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/proc 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/sys 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/dev 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/security 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/shm 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/pts 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/run 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/cgroup 2024-05-14T15:16:33.476 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/pstore 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/bpf 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/ 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/selinux 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/hugepages 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/mqueue 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/debug 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/tracing 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/config 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/run/user/1000 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:33.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:33.479 DEBUG:teuthology.orchestra.run.smithi156:> ls /sys/fs/fuse/connections 2024-05-14T15:16:33.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi156.stderr:2024-05-14T15:16:33.639+0000 7ff1eb3b8480 -1 init, newargv = 0x7ff1d4054030 newargc=15 2024-05-14T15:16:33.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi156.stderr:ceph-fuse[41381]: starting ceph client 2024-05-14T15:16:33.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi156.stderr:ceph-fuse[41381]: starting fuse 2024-05-14T15:16:34.667 DEBUG:teuthology.orchestra.run.smithi156:> sudo modprobe fuse 2024-05-14T15:16:34.760 DEBUG:teuthology.orchestra.run.smithi156:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/proc 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/sys 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/dev 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/security 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/shm 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/pts 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/run 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/cgroup 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/pstore 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/bpf 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/ 2024-05-14T15:16:34.816 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/selinux 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/hugepages 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/mqueue 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/debug 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/tracing 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/config 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/run/user/1000 2024-05-14T15:16:34.817 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:34.818 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:34.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:34.819 DEBUG:teuthology.orchestra.run.smithi156:> ls /sys/fs/fuse/connections 2024-05-14T15:16:34.869 INFO:teuthology.orchestra.run.smithi156.stdout:42 2024-05-14T15:16:34.870 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> import glob 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> import re 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> import os 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> import subprocess 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> def _find_admin_socket(client_name): 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> files = glob.glob(asok_path) 2024-05-14T15:16:34.870 DEBUG:teuthology.orchestra.run.smithi156:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> # Given a non-glob path, it better be there 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> if "*" not in asok_path: 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> assert(len(files) == 1) 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> return files[0] 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> for f in files: 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> contents = proc_f.read() 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> if mountpoint in contents: 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> return f 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:34.871 DEBUG:teuthology.orchestra.run.smithi156:> print(_find_admin_socket("client.1")) 2024-05-14T15:16:34.872 DEBUG:teuthology.orchestra.run.smithi156:> ' 2024-05-14T15:16:35.038 INFO:teuthology.orchestra.run.smithi156.stdout:/var/run/ceph/ceph-client.1.41381.asok 2024-05-14T15:16:35.042 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:35.055 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41381.asok 2024-05-14T15:16:35.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:35.056 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41381.asok status 2024-05-14T15:16:35.355 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-05-14T15:16:35.355 INFO:teuthology.orchestra.run.smithi156.stdout: "metadata": { 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "entity_id": "1", 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "hostname": "smithi156", 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "pid": "41381", 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "root": "/" 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "dentry_count": 0, 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "dentry_pinned_count": 0, 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "id": 4600, 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "inst": { 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "name": { 2024-05-14T15:16:35.356 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "client", 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "num": 4600 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": { 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 2286749985 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": { 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 2286749985 2024-05-14T15:16:35.357 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "inst_str": "client.4600 192.168.0.1:0/2286749985", 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "addr_str": "192.168.0.1:0/2286749985", 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "inode_count": 1, 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_epoch": 8, 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_epoch": 28, 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "blocklisted": false, 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout: "fs_name": "cephfs" 2024-05-14T15:16:35.358 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-05-14T15:16:35.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T15:16:35.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.667+0000 7f22aca00640 1 Processor -- start 2024-05-14T15:16:35.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.667+0000 7f22aca00640 1 -- start start 2024-05-14T15:16:35.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.669+0000 7f22aca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22a80b6ab0 0x7f22a815df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:35.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.669+0000 7f22aca00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22a80d08c0 0x7f22a80d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:35.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f22aca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a8162920 con 0x7f22a8161a10 2024-05-14T15:16:35.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f22aca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f22a8162360 con 0x7f22a80b6ab0 2024-05-14T15:16:35.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f22aca00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f22a8162640 con 0x7f22a80d08c0 2024-05-14T15:16:35.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f229ea00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f22a8161a10 0x7f22a80d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36892/0 (socket says 172.21.15.2:36892) 2024-05-14T15:16:35.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f229ea00640 1 -- 172.21.15.2:0/4266058707 learned_addr learned my addr 172.21.15.2:0/4266058707 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:35.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f22a7400640 1 --2- 172.21.15.2:0/4266058707 >> v2:172.21.15.2:3300/0 conn(0x7f22a80b6ab0 0x7f22a815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.670+0000 7f22a7e00640 1 --2- 172.21.15.2:0/4266058707 >> v2:172.21.15.156:3300/0 conn(0x7f22a80d08c0 0x7f22a80d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a6a00640 1 -- 172.21.15.2:0/4266058707 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612549108 0 0) 0x7f2290001110 con 0x7f22a8161a10 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a6a00640 1 -- 172.21.15.2:0/4266058707 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f228c003520 con 0x7f22a8161a10 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a7400640 1 -- 172.21.15.2:0/4266058707 >> v2:172.21.15.156:3300/0 conn(0x7f22a80d08c0 msgr2=0x7f22a80d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a7400640 1 --2- 172.21.15.2:0/4266058707 >> v2:172.21.15.156:3300/0 conn(0x7f22a80d08c0 0x7f22a80d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a7400640 1 -- 172.21.15.2:0/4266058707 >> v1:172.21.15.2:6789/0 conn(0x7f22a8161a10 legacy=0x7f22a80d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a7400640 1 -- 172.21.15.2:0/4266058707 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a80d1f50 con 0x7f22a80b6ab0 2024-05-14T15:16:35.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.671+0000 7f22a7e00640 1 --2- 172.21.15.2:0/4266058707 >> v2:172.21.15.156:3300/0 conn(0x7f22a80d08c0 0x7f22a80d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:35.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.672+0000 7f22a7400640 1 --2- 172.21.15.2:0/4266058707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a815df10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22a8071460 tx=0x7f229802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d1ddb1ab1fa394 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:35.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.672+0000 7f22a6a00640 1 -- 172.21.15.2:0/4266058707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298037070 con 0x7f22a80b6ab0 2024-05-14T15:16:35.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.672+0000 7f22a6a00640 1 -- 172.21.15.2:0/4266058707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2298032440 con 0x7f22a80b6ab0 2024-05-14T15:16:35.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.672+0000 7f22a6a00640 1 -- 172.21.15.2:0/4266058707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229802ae60 con 0x7f22a80b6ab0 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 -- 172.21.15.2:0/4266058707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 msgr2=0x7f22a815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 --2- 172.21.15.2:0/4266058707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a815df10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22a8071460 tx=0x7f229802a110 comp rx=0 tx=0).stop 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 -- 172.21.15.2:0/4266058707 shutdown_connections 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 --2- 172.21.15.2:0/4266058707 >> v2:172.21.15.156:3300/0 conn(0x7f22a80d08c0 0x7f22a80d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 --2- 172.21.15.2:0/4266058707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a815df10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 -- 172.21.15.2:0/4266058707 >> 172.21.15.2:0/4266058707 conn(0x7f22a80b52e0 msgr2=0x7f22a80b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 -- 172.21.15.2:0/4266058707 shutdown_connections 2024-05-14T15:16:35.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.673+0000 7f22aca00640 1 -- 172.21.15.2:0/4266058707 wait complete. 2024-05-14T15:16:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.676+0000 7f22aca00640 1 Processor -- start 2024-05-14T15:16:35.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.676+0000 7f22aca00640 1 -- start start 2024-05-14T15:16:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.677+0000 7f22aca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.677+0000 7f22aca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22a80d08c0 0x7f22a80ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.677+0000 7f22aca00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22a8161a10 0x7f22a806f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.677+0000 7f22aca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80ce420 con 0x7f22a80b6ab0 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.677+0000 7f22aca00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80ce2a0 con 0x7f22a80d08c0 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.677+0000 7f22aca00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f22a8161e20 con 0x7f22a8161a10 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a81579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49102/0 (socket says 172.21.15.2:49102) 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 -- 172.21.15.2:0/4241306177 learned_addr learned my addr 172.21.15.2:0/4241306177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 -- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22a8161a10 msgr2=0x7f22a806f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22a8161a10 0x7f22a806f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 -- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22a80d08c0 msgr2=0x7f22a80ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22a80d08c0 0x7f22a80ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 -- 172.21.15.2:0/4241306177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a8157f30 con 0x7f22a80b6ab0 2024-05-14T15:16:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.678+0000 7f22a7400640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a81579f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2298000c00 tx=0x7f22980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.679+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298037040 con 0x7f22a80b6ab0 2024-05-14T15:16:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.679+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2298042070 con 0x7f22a80b6ab0 2024-05-14T15:16:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.679+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298030960 con 0x7f22a80b6ab0 2024-05-14T15:16:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.679+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a80cb340 con 0x7f22a80b6ab0 2024-05-14T15:16:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.679+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a80cb900 con 0x7f22a80b6ab0 2024-05-14T15:16:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.680+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a8050870 con 0x7f22a80b6ab0 2024-05-14T15:16:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.681+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2298030b00 con 0x7f22a80b6ab0 2024-05-14T15:16:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.682+0000 7f229fe00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f22840762d0 0x7f22840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.682+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f22980b81e0 con 0x7f22a80b6ab0 2024-05-14T15:16:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.683+0000 7f229ea00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f22840762d0 0x7f22840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.684+0000 7f229ea00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f22840762d0 0x7f22840787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2290001410 tx=0x7f2290001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.687+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f229804c020 con 0x7f22a80b6ab0 2024-05-14T15:16:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.937+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f22a80d25a0 con 0x7f22a80b6ab0 2024-05-14T15:16:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.938+0000 7f229fe00640 1 -- 172.21.15.2:0/4241306177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f2298081730 con 0x7f22a80b6ab0 2024-05-14T15:16:35.937 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:16:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.940+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f22840762d0 msgr2=0x7f22840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.940+0000 7f22aca00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f22840762d0 0x7f22840787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2290001410 tx=0x7f2290001260 comp rx=0 tx=0).stop 2024-05-14T15:16:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.940+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 msgr2=0x7f22a81579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.940+0000 7f22aca00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a81579f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2298000c00 tx=0x7f22980046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 shutdown_connections 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f22840762d0 0x7f22840787e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22a80d08c0 0x7f22a80ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22a8161a10 0x7f22a806f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 --2- 172.21.15.2:0/4241306177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a80b6ab0 0x7f22a81579f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 >> 172.21.15.2:0/4241306177 conn(0x7f22a80b52e0 msgr2=0x7f22a815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 shutdown_connections 2024-05-14T15:16:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:35.941+0000 7f22aca00640 1 -- 172.21.15.2:0/4241306177 wait complete. 2024-05-14T15:16:35.964 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T15:16:35.964 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:16:35.964 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi156.front.sepia.ceph.com 2024-05-14T15:16:35.965 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-14T15:16:35.965 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:35.965 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T15:16:35.965 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:16:35.965 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:16:35.965 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-14T15:16:35.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:35.965 DEBUG:teuthology.orchestra.run.smithi156:> ip addr 2024-05-14T15:16:36.022 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:36.022 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c0 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f0 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c1 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f1 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fc brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:36.023 INFO:teuthology.orchestra.run.smithi156.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fd brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.21.15.156/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft 42533sec preferred_lft 42533sec 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec4:7aff:fe88:6dfd/64 scope link 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether c2:6d:72:fe:a6:ff brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec67:6dff:fe6f:8e/64 scope link 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether c2:6d:72:fe:a6:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::c06d:72ff:fefe:a6ff/64 scope link 2024-05-14T15:16:36.024 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:36.026 DEBUG:teuthology.orchestra.run.smithi156:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:16:36.105 INFO:teuthology.orchestra.run.smithi156.stdout:1 2024-05-14T15:16:36.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:36.109 DEBUG:teuthology.orchestra.run.smithi156:> route 2024-05-14T15:16:36.161 INFO:teuthology.orchestra.run.smithi156.stdout:Kernel IP routing table 2024-05-14T15:16:36.162 INFO:teuthology.orchestra.run.smithi156.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:16:36.162 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T15:16:36.162 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T15:16:36.162 INFO:teuthology.orchestra.run.smithi156.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:16:36.162 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:36.162 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:36.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T15:16:36.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T15:16:36.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T15:16:36.163 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:36.266 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:36.365 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:36.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:36.374 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-05-14T15:16:36.421 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-14T15:16:36.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:36.422 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list-id 2024-05-14T15:16:36.518 INFO:teuthology.orchestra.run.smithi156.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-14T15:16:36.519 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:36.520 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:36.520 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:36.520 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-14T15:16:36.520 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:36.625 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:36.693 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:36.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:36.703 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-14T15:16:36.782 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:36.782 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:36.782 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:36.782 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.782 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether a6:cf:e4:f6:1b:5b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::a4cf:e4ff:fef6:1b5b/64 scope link 2024-05-14T15:16:36.783 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:36.785 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-14T15:16:36.867 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether a6:cf:e4:f6:1b:5b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::a4cf:e4ff:fef6:1b5b/64 scope link 2024-05-14T15:16:36.868 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:36.872 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-14T15:16:36.873 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:36.979 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:37.138 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:37.147 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:37.147 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-05-14T15:16:37.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set brx.1 up 2024-05-14T15:16:37.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set dev brx.1 master ceph-brx 2024-05-14T15:16:37.147 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-05-14T15:16:37.234 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:37.338 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-14T15:16:37.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:37.338 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:37.384 INFO:teuthology.orchestra.run.smithi156.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-14T15:16:37.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:16:37.385 DEBUG:teuthology.orchestra.run.smithi156:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:37.479 DEBUG:teuthology.orchestra.run.smithi156:> sudo modprobe fuse 2024-05-14T15:16:37.566 DEBUG:teuthology.orchestra.run.smithi156:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/proc 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/sys 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/dev 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/security 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/shm 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/pts 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/run 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/cgroup 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/pstore 2024-05-14T15:16:37.622 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/bpf 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/ 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/selinux 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/hugepages 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/mqueue 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/debug 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/tracing 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/config 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:37.623 INFO:teuthology.orchestra.run.smithi156.stdout:/run/user/1000 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:37.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:37.626 DEBUG:teuthology.orchestra.run.smithi156:> ls /sys/fs/fuse/connections 2024-05-14T15:16:37.677 INFO:teuthology.orchestra.run.smithi156.stdout:42 2024-05-14T15:16:37.677 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-05-14T15:16:37.677 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-14T15:16:37.682 DEBUG:teuthology.orchestra.run.smithi156:> sudo modprobe fuse 2024-05-14T15:16:37.749 DEBUG:teuthology.orchestra.run.smithi156:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:37.793 INFO:teuthology.orchestra.run.smithi156.stdout:/proc 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/sys 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/dev 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/security 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/shm 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/pts 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/run 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/cgroup 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/pstore 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/bpf 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/ 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/selinux 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:37.794 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/hugepages 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/mqueue 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/debug 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/tracing 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/config 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/run/user/1000 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T15:16:37.795 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:37.796 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:37.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:37.797 DEBUG:teuthology.orchestra.run.smithi156:> ls /sys/fs/fuse/connections 2024-05-14T15:16:37.885 INFO:teuthology.orchestra.run.smithi156.stdout:42 2024-05-14T15:16:37.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi156.stderr:2024-05-14T15:16:37.923+0000 7f1fcbc88480 -1 init, newargv = 0x55ebc4cd75f0 newargc=15 2024-05-14T15:16:37.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi156.stderr:ceph-fuse[41904]: starting ceph client 2024-05-14T15:16:37.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi156.stderr:ceph-fuse[41904]: starting fuse 2024-05-14T15:16:38.986 DEBUG:teuthology.orchestra.run.smithi156:> sudo modprobe fuse 2024-05-14T15:16:39.077 DEBUG:teuthology.orchestra.run.smithi156:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:16:39.134 INFO:teuthology.orchestra.run.smithi156.stdout:/proc 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/sys 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/dev 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/security 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/shm 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/pts 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/run 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/cgroup 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/pstore 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/bpf 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/ 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/selinux 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:16:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/hugepages 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/dev/mqueue 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/debug 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/tracing 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/fs/fuse/connections 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/sys/kernel/config 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/run/user/1000 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T15:16:39.136 INFO:teuthology.orchestra.run.smithi156.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:16:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:/home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:39.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.138 DEBUG:teuthology.orchestra.run.smithi156:> ls /sys/fs/fuse/connections 2024-05-14T15:16:39.188 INFO:teuthology.orchestra.run.smithi156.stdout:42 2024-05-14T15:16:39.188 INFO:teuthology.orchestra.run.smithi156.stdout:43 2024-05-14T15:16:39.188 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> import glob 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> import re 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> import os 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> import subprocess 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> def _find_admin_socket(client_name): 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> files = glob.glob(asok_path) 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> # Given a non-glob path, it better be there 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> if "*" not in asok_path: 2024-05-14T15:16:39.189 DEBUG:teuthology.orchestra.run.smithi156:> assert(len(files) == 1) 2024-05-14T15:16:39.190 DEBUG:teuthology.orchestra.run.smithi156:> return files[0] 2024-05-14T15:16:39.190 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:39.190 DEBUG:teuthology.orchestra.run.smithi156:> for f in files: 2024-05-14T15:16:39.190 DEBUG:teuthology.orchestra.run.smithi156:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:16:39.190 DEBUG:teuthology.orchestra.run.smithi156:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:16:39.190 DEBUG:teuthology.orchestra.run.smithi156:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> contents = proc_f.read() 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> if mountpoint in contents: 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> return f 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> print(_find_admin_socket("client.3")) 2024-05-14T15:16:39.191 DEBUG:teuthology.orchestra.run.smithi156:> ' 2024-05-14T15:16:39.354 INFO:teuthology.orchestra.run.smithi156.stdout:/var/run/ceph/ceph-client.3.41904.asok 2024-05-14T15:16:39.358 INFO:teuthology.orchestra.run.smithi156.stderr:2024-05-14T15:16:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:39.370 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41904.asok 2024-05-14T15:16:39.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.371 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41904.asok status 2024-05-14T15:16:39.660 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-05-14T15:16:39.660 INFO:teuthology.orchestra.run.smithi156.stdout: "metadata": { 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "entity_id": "3", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "hostname": "smithi156", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "pid": "41904", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "root": "/" 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "dentry_count": 0, 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "dentry_pinned_count": 0, 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "id": 4609, 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "inst": { 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "name": { 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "client", 2024-05-14T15:16:39.661 INFO:teuthology.orchestra.run.smithi156.stdout: "num": 4609 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": { 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "192.168.0.2:0", 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 2287100028 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": { 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "192.168.0.2:0", 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 2287100028 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "inst_str": "client.4609 192.168.0.2:0/2287100028", 2024-05-14T15:16:39.662 INFO:teuthology.orchestra.run.smithi156.stdout: "addr_str": "192.168.0.2:0/2287100028", 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout: "inode_count": 1, 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_epoch": 8, 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_epoch": 28, 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout: "blocklisted": false, 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout: "fs_name": "cephfs" 2024-05-14T15:16:39.663 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-05-14T15:16:39.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.680 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-05-14T15:16:39.680 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-05-14T15:16:39.744 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:39.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:39.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.836 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-05-14T15:16:39.836 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-05-14T15:16:39.895 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:39.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:39.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:39.984 DEBUG:teuthology.orchestra.run.smithi156:> stat --file-system '--printf=%T 2024-05-14T15:16:39.984 DEBUG:teuthology.orchestra.run.smithi156:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:40.044 INFO:teuthology.orchestra.run.smithi156.stdout:fuseblk 2024-05-14T15:16:40.044 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:40.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:40.045 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:40.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:40.129 DEBUG:teuthology.orchestra.run.smithi156:> stat --file-system '--printf=%T 2024-05-14T15:16:40.129 DEBUG:teuthology.orchestra.run.smithi156:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:40.184 INFO:teuthology.orchestra.run.smithi156.stdout:fuseblk 2024-05-14T15:16:40.184 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:40.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:40.184 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:40.270 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-14T15:16:40.361 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-05-14T15:16:40.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:40.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:40.377 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.636+0000 7fe488200640 1 Processor -- start 2024-05-14T15:16:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.636+0000 7fe488200640 1 -- start start 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.638+0000 7fe488200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.638+0000 7fe488200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe480071530 0x7fe4800af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.638+0000 7fe488200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe48006d700 0x7fe48006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.638+0000 7fe488200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe48015f350 con 0x7fe48006d700 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.638+0000 7fe488200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fe4800d1460 con 0x7fe480071530 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.638+0000 7fe488200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe48006e050 con 0x7fe48015bb90 2024-05-14T15:16:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe48006d700 0x7fe48006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe48006d700 0x7fe48006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50780/0 (socket says 172.21.15.2:50780) 2024-05-14T15:16:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 -- 172.21.15.2:0/1683528137 learned_addr learned my addr 172.21.15.2:0/1683528137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe485800640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe484e00640 1 --2- 172.21.15.2:0/1683528137 >> v2:172.21.15.156:3300/0 conn(0x7fe480071530 0x7fe4800af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 -- 172.21.15.2:0/1683528137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 msgr2=0x7fe48015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 -- 172.21.15.2:0/1683528137 >> v2:172.21.15.156:3300/0 conn(0x7fe480071530 msgr2=0x7fe4800af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 --2- 172.21.15.2:0/1683528137 >> v2:172.21.15.156:3300/0 conn(0x7fe480071530 0x7fe4800af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe486200640 1 -- 172.21.15.2:0/1683528137 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48015ed90 con 0x7fe48006d700 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe485800640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.639+0000 7fe484e00640 1 --2- 172.21.15.2:0/1683528137 >> v2:172.21.15.156:3300/0 conn(0x7fe480071530 0x7fe4800af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.640+0000 7fe486200640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48006d700 0x7fe48006db10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe48006e200 tx=0x7fe47802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb53bc9a7fbb6818 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.641+0000 7fe47fe00640 1 -- 172.21.15.2:0/1683528137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478036070 con 0x7fe48006d700 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.641+0000 7fe47fe00640 1 -- 172.21.15.2:0/1683528137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe478031600 con 0x7fe48006d700 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.641+0000 7fe47fe00640 1 -- 172.21.15.2:0/1683528137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4780319d0 con 0x7fe48006d700 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 -- 172.21.15.2:0/1683528137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48006d700 msgr2=0x7fe48006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48006d700 0x7fe48006db10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe48006e200 tx=0x7fe47802a5f0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 -- 172.21.15.2:0/1683528137 shutdown_connections 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48006d700 0x7fe48006db10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 --2- 172.21.15.2:0/1683528137 >> v2:172.21.15.156:3300/0 conn(0x7fe480071530 0x7fe4800af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 --2- 172.21.15.2:0/1683528137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 -- 172.21.15.2:0/1683528137 >> 172.21.15.2:0/1683528137 conn(0x7fe4800d1d10 msgr2=0x7fe4800734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 -- 172.21.15.2:0/1683528137 shutdown_connections 2024-05-14T15:16:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.642+0000 7fe488200640 1 -- 172.21.15.2:0/1683528137 wait complete. 2024-05-14T15:16:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.644+0000 7fe488200640 1 Processor -- start 2024-05-14T15:16:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.645+0000 7fe488200640 1 -- start start 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.646+0000 7fe488200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe48006d700 0x7fe4801f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.646+0000 7fe488200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 0x7fe48009b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.646+0000 7fe488200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48009bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.646+0000 7fe488200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4800aeb60 con 0x7fe480071530 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.646+0000 7fe488200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe4800ae880 con 0x7fe48006d700 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.646+0000 7fe488200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe48015e980 con 0x7fe48015bb90 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 0x7fe48009b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 0x7fe48009b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50796/0 (socket says 172.21.15.2:50796) 2024-05-14T15:16:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 -- 172.21.15.2:0/1774327918 learned_addr learned my addr 172.21.15.2:0/1774327918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe485800640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe48006d700 0x7fe4801f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe486200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48009bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 -- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 msgr2=0x7fe48009bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48009bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 -- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe48006d700 msgr2=0x7fe4801f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe48006d700 0x7fe4801f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.647+0000 7fe484e00640 1 -- 172.21.15.2:0/1774327918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe480154e20 con 0x7fe480071530 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.648+0000 7fe484e00640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 0x7fe48009b790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00c820 tx=0x7fe46c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.648+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c015070 con 0x7fe480071530 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.648+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c004020 con 0x7fe480071530 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.648+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0043f0 con 0x7fe480071530 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.648+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe480155100 con 0x7fe480071530 2024-05-14T15:16:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.648+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4801556c0 con 0x7fe480071530 2024-05-14T15:16:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.649+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe480050870 con 0x7fe480071530 2024-05-14T15:16:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.651+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe46c007830 con 0x7fe480071530 2024-05-14T15:16:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.651+0000 7fe47d600640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4600762d0 0x7fe4600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.652+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fe46c097840 con 0x7fe480071530 2024-05-14T15:16:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.652+0000 7fe485800640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4600762d0 0x7fe4600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.654+0000 7fe485800640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4600762d0 0x7fe4600787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe4800b0c00 tx=0x7fe470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.657+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe46c060d00 con 0x7fe480071530 2024-05-14T15:16:40.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.870+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe480073840 con 0x7fe480071530 2024-05-14T15:16:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.874+0000 7fe47d600640 1 -- 172.21.15.2:0/1774327918 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18541 (secure 0 0 0) 0x7fe46c060600 con 0x7fe480071530 2024-05-14T15:16:40.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:16:29.950718+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4600762d0 msgr2=0x7fe4600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4600762d0 0x7fe4600787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe4800b0c00 tx=0x7fe470008040 comp rx=0 tx=0).stop 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 msgr2=0x7fe48009b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 0x7fe48009b790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00c820 tx=0x7fe46c00cce0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 shutdown_connections 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe4600762d0 0x7fe4600787e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48015bb90 0x7fe48009bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe480071530 0x7fe48009b790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 --2- 172.21.15.2:0/1774327918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe48006d700 0x7fe4801f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 >> 172.21.15.2:0/1774327918 conn(0x7fe4800d1d10 msgr2=0x7fe4800af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 shutdown_connections 2024-05-14T15:16:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:40.877+0000 7fe488200640 1 -- 172.21.15.2:0/1774327918 wait complete. 2024-05-14T15:16:40.902 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T15:15:36.876399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T15:15:40.859291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T15:15:41.942717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-14T15:15:45.451703+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-14T15:16:40.902 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T15:16:41.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.191+0000 7f0129000640 1 Processor -- start 2024-05-14T15:16:41.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.191+0000 7f0129000640 1 -- start start 2024-05-14T15:16:41.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.193+0000 7f0129000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f012415db90 0x7f01240d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.193+0000 7f0129000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f0124163a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.193+0000 7f0129000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0124164360 con 0x7f0124163f50 2024-05-14T15:16:41.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.193+0000 7f0129000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f01240d4810 con 0x7f012415db90 2024-05-14T15:16:41.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.193+0000 7f0129000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f01240d4af0 con 0x7f01240d0ee0 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f012415db90 0x7f01240d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0124163f50 0x7f01240b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59852/0 (socket says 172.21.15.2:59852) 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123e00640 1 -- 172.21.15.2:0/444488757 learned_addr learned my addr 172.21.15.2:0/444488757 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0122a00640 1 --2- 172.21.15.2:0/444488757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f0124163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123400640 1 -- 172.21.15.2:0/444488757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 msgr2=0x7f0124163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123400640 1 --2- 172.21.15.2:0/444488757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f0124163a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123400640 1 -- 172.21.15.2:0/444488757 >> v1:172.21.15.2:6789/0 conn(0x7f0124163f50 legacy=0x7f01240b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.194+0000 7f0123400640 1 -- 172.21.15.2:0/444488757 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01240d4dd0 con 0x7f012415db90 2024-05-14T15:16:41.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.195+0000 7f0123400640 1 --2- 172.21.15.2:0/444488757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240d41a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0114009d90 tx=0x7f011402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40de2699edf8fe01 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:41.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.196+0000 7f0122000640 1 -- 172.21.15.2:0/444488757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114031600 con 0x7f012415db90 2024-05-14T15:16:41.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.196+0000 7f0122000640 1 -- 172.21.15.2:0/444488757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01140317a0 con 0x7f012415db90 2024-05-14T15:16:41.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.196+0000 7f0122000640 1 -- 172.21.15.2:0/444488757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114031b70 con 0x7f012415db90 2024-05-14T15:16:41.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.196+0000 7f0129000640 1 -- 172.21.15.2:0/444488757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 msgr2=0x7f01240d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.196+0000 7f0129000640 1 --2- 172.21.15.2:0/444488757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240d41a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0114009d90 tx=0x7f011402a5d0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.196+0000 7f0129000640 1 -- 172.21.15.2:0/444488757 shutdown_connections 2024-05-14T15:16:41.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.197+0000 7f0129000640 1 --2- 172.21.15.2:0/444488757 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f0124163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.197+0000 7f0129000640 1 --2- 172.21.15.2:0/444488757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240d41a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.197+0000 7f0129000640 1 -- 172.21.15.2:0/444488757 >> 172.21.15.2:0/444488757 conn(0x7f01240d6040 msgr2=0x7f01240b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:41.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.197+0000 7f0129000640 1 -- 172.21.15.2:0/444488757 shutdown_connections 2024-05-14T15:16:41.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.197+0000 7f0129000640 1 -- 172.21.15.2:0/444488757 wait complete. 2024-05-14T15:16:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.199+0000 7f0129000640 1 Processor -- start 2024-05-14T15:16:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.199+0000 7f0129000640 1 -- start start 2024-05-14T15:16:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0129000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f01240ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0129000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0129000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0124163f50 0x7f012415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0129000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01240d1470 con 0x7f012415db90 2024-05-14T15:16:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0129000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f01240d12f0 con 0x7f0124163f50 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0129000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f01240b4bd0 con 0x7f01240d0ee0 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0122a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0122a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50814/0 (socket says 172.21.15.2:50814) 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0122a00640 1 -- 172.21.15.2:0/1336133494 learned_addr learned my addr 172.21.15.2:0/1336133494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.201+0000 7f0123400640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f01240ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0123e00640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0124163f50 0x7f012415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0122a00640 1 -- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 msgr2=0x7f01240ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0122a00640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f01240ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0122a00640 1 -- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0124163f50 msgr2=0x7f012415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0122a00640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0124163f50 0x7f012415c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0122a00640 1 -- 172.21.15.2:0/1336133494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241f6b80 con 0x7f012415db90 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0123400640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f01240ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0122a00640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240cf860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c7f0 tx=0x7f010c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:41.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c015070 con 0x7f012415db90 2024-05-14T15:16:41.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c004220 con 0x7f012415db90 2024-05-14T15:16:41.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c007620 con 0x7f012415db90 2024-05-14T15:16:41.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01241f6e60 con 0x7f012415db90 2024-05-14T15:16:41.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.202+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012415c570 con 0x7f012415db90 2024-05-14T15:16:41.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.204+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01241f68f0 con 0x7f012415db90 2024-05-14T15:16:41.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.205+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f010c0077c0 con 0x7f012415db90 2024-05-14T15:16:41.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.207+0000 7f011b400640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0100076300 0x7f0100078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.207+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f010c097800 con 0x7f012415db90 2024-05-14T15:16:41.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.208+0000 7f0123400640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0100076300 0x7f0100078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.209+0000 7f0123400640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0100076300 0x7f0100078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0114034000 tx=0x7f0114033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:41.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.212+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f010c060cc0 con 0x7f012415db90 2024-05-14T15:16:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.419+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0124050870 con 0x7f012415db90 2024-05-14T15:16:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.421+0000 7f011b400640 1 -- 172.21.15.2:0/1336133494 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f010c0605c0 con 0x7f012415db90 2024-05-14T15:16:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0100076300 msgr2=0x7f0100078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0100076300 0x7f0100078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0114034000 tx=0x7f0114033040 comp rx=0 tx=0).stop 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 msgr2=0x7f01240cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240cf860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c7f0 tx=0x7f010c00ccb0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 shutdown_connections 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0100076300 0x7f0100078810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0124163f50 0x7f012415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012415db90 0x7f01240cf860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 --2- 172.21.15.2:0/1336133494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01240d0ee0 0x7f01240ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 >> 172.21.15.2:0/1336133494 conn(0x7f01240d6040 msgr2=0x7f0124161d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 shutdown_connections 2024-05-14T15:16:41.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.423+0000 7f0129000640 1 -- 172.21.15.2:0/1336133494 wait complete. 2024-05-14T15:16:41.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T15:16:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.715+0000 7fa3fd600640 1 Processor -- start 2024-05-14T15:16:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.715+0000 7fa3fd600640 1 -- start start 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3fd600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa3f80709e0 0x7fa3f80b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3fd600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa3f80cf910 0x7fa3f80cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3fd600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f80aee60 con 0x7fa3f81618e0 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3fd600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa3f80af140 con 0x7fa3f80709e0 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3fd600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fa3f80af420 con 0x7fa3f80cf910 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3efe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa3f81618e0 0x7fa3f8161cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59854/0 (socket says 172.21.15.2:59854) 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3efe00640 1 -- 172.21.15.2:0/1903910732 learned_addr learned my addr 172.21.15.2:0/1903910732 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.718+0000 7fa3f7e00640 1 --2- 172.21.15.2:0/1903910732 >> v2:172.21.15.2:3300/0 conn(0x7fa3f80709e0 0x7fa3f80b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7400640 1 -- 172.21.15.2:0/1903910732 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131829974 0 0) 0x7fa3f80aee60 con 0x7fa3f81618e0 2024-05-14T15:16:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3fcc00640 1 --2- 172.21.15.2:0/1903910732 >> v2:172.21.15.156:3300/0 conn(0x7fa3f80cf910 0x7fa3f80cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7400640 1 -- 172.21.15.2:0/1903910732 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3d8003520 con 0x7fa3f81618e0 2024-05-14T15:16:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7e00640 1 -- 172.21.15.2:0/1903910732 >> v2:172.21.15.156:3300/0 conn(0x7fa3f80cf910 msgr2=0x7fa3f80cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7e00640 1 --2- 172.21.15.2:0/1903910732 >> v2:172.21.15.156:3300/0 conn(0x7fa3f80cf910 0x7fa3f80cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7e00640 1 -- 172.21.15.2:0/1903910732 >> v1:172.21.15.2:6789/0 conn(0x7fa3f81618e0 legacy=0x7fa3f8161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7400640 1 -- 172.21.15.2:0/1903910732 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1291275235 0 0) 0x7fa3d8003520 con 0x7fa3f81618e0 2024-05-14T15:16:41.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.719+0000 7fa3f7e00640 1 -- 172.21.15.2:0/1903910732 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f80af700 con 0x7fa3f80709e0 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.720+0000 7fa3f7e00640 1 --2- 172.21.15.2:0/1903910732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f80709e0 0x7fa3f80b0ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80ce250 tx=0x7fa3e802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b65f380573913f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3f7400640 1 -- 172.21.15.2:0/1903910732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8037070 con 0x7fa3f80709e0 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3f7400640 1 -- 172.21.15.2:0/1903910732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e802ab30 con 0x7fa3f80709e0 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3f7400640 1 -- 172.21.15.2:0/1903910732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00016f0 con 0x7fa3f80709e0 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 -- 172.21.15.2:0/1903910732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f80709e0 msgr2=0x7fa3f80b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 --2- 172.21.15.2:0/1903910732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f80709e0 0x7fa3f80b0ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80ce250 tx=0x7fa3e802a0a0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 -- 172.21.15.2:0/1903910732 shutdown_connections 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 --2- 172.21.15.2:0/1903910732 >> v2:172.21.15.156:3300/0 conn(0x7fa3f80cf910 0x7fa3f80cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 --2- 172.21.15.2:0/1903910732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f80709e0 0x7fa3f80b0ae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 -- 172.21.15.2:0/1903910732 >> 172.21.15.2:0/1903910732 conn(0x7fa3f80739a0 msgr2=0x7fa3f8073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 -- 172.21.15.2:0/1903910732 shutdown_connections 2024-05-14T15:16:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.721+0000 7fa3fd600640 1 -- 172.21.15.2:0/1903910732 wait complete. 2024-05-14T15:16:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.724+0000 7fa3fd600640 1 Processor -- start 2024-05-14T15:16:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.724+0000 7fa3fd600640 1 -- start start 2024-05-14T15:16:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.725+0000 7fa3fd600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3f80709e0 0x7fa3f814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.725+0000 7fa3fd600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3f80cf910 0x7fa3f80b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.725+0000 7fa3fd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 0x7fa3f80cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.725+0000 7fa3fd600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81626c0 con 0x7fa3f81618e0 2024-05-14T15:16:41.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.725+0000 7fa3fd600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8070df0 con 0x7fa3f80cf910 2024-05-14T15:16:41.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.725+0000 7fa3fd600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f80b1020 con 0x7fa3f80709e0 2024-05-14T15:16:41.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 0x7fa3f80cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 0x7fa3f80cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50832/0 (socket says 172.21.15.2:50832) 2024-05-14T15:16:41.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 -- 172.21.15.2:0/704022970 learned_addr learned my addr 172.21.15.2:0/704022970 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:41.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3f7e00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3f80709e0 0x7fa3f814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3efe00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3f80cf910 0x7fa3f80b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 -- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3f80709e0 msgr2=0x7fa3f814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3f80709e0 0x7fa3f814a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 -- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3f80cf910 msgr2=0x7fa3f80b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3f80cf910 0x7fa3f80b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3fcc00640 1 -- 172.21.15.2:0/704022970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f814a5f0 con 0x7fa3f81618e0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.726+0000 7fa3efe00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3f80cf910 0x7fa3f80b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.727+0000 7fa3fcc00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 0x7fa3f80cfd20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007e60 tx=0x7fa3f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.727+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0014420 con 0x7fa3f81618e0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.727+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f0019070 con 0x7fa3f81618e0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.727+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0014820 con 0x7fa3f81618e0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.727+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f8152bf0 con 0x7fa3f81618e0 2024-05-14T15:16:41.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.727+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81531b0 con 0x7fa3f81618e0 2024-05-14T15:16:41.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.728+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f80b6640 con 0x7fa3f81618e0 2024-05-14T15:16:41.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.730+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3f00149c0 con 0x7fa3f81618e0 2024-05-14T15:16:41.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.731+0000 7fa3f4c00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa3d40762d0 0x7fa3d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:41.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.731+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fa3f00982e0 con 0x7fa3f81618e0 2024-05-14T15:16:41.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.732+0000 7fa3f7e00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa3d40762d0 0x7fa3d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:41.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.733+0000 7fa3f7e00640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa3d40762d0 0x7fa3d40787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8034000 tx=0x7fa3e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:41.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.736+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa3f00617a0 con 0x7fa3f81618e0 2024-05-14T15:16:41.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.942+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa3f8050870 con 0x7fa3f81618e0 2024-05-14T15:16:41.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.943+0000 7fa3f4c00640 1 -- 172.21.15.2:0/704022970 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fa3f00610a0 con 0x7fa3f81618e0 2024-05-14T15:16:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-05-14T15:16:41.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.945+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa3d40762d0 msgr2=0x7fa3d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.945+0000 7fa3fd600640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa3d40762d0 0x7fa3d40787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8034000 tx=0x7fa3e802e000 comp rx=0 tx=0).stop 2024-05-14T15:16:41.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.945+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 msgr2=0x7fa3f80cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:41.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.945+0000 7fa3fd600640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 0x7fa3f80cfd20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007e60 tx=0x7fa3f000e4b0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.945+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 shutdown_connections 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa3d40762d0 0x7fa3d40787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3f80cf910 0x7fa3f80b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f81618e0 0x7fa3f80cfd20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 --2- 172.21.15.2:0/704022970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3f80709e0 0x7fa3f814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 >> 172.21.15.2:0/704022970 conn(0x7fa3f80739a0 msgr2=0x7fa3f8073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 shutdown_connections 2024-05-14T15:16:41.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:41.946+0000 7fa3fd600640 1 -- 172.21.15.2:0/704022970 wait complete. 2024-05-14T15:16:41.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T15:16:42.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.257+0000 7fc9ab000640 1 Processor -- start 2024-05-14T15:16:42.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.257+0000 7fc9ab000640 1 -- start start 2024-05-14T15:16:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.259+0000 7fc9ab000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9a415db90 0x7fc9a40d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.259+0000 7fc9ab000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a40d4810 con 0x7fc9a40d0ee0 2024-05-14T15:16:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.259+0000 7fc9ab000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a40d4af0 con 0x7fc9a4164120 2024-05-14T15:16:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.259+0000 7fc9ab000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a40d4dd0 con 0x7fc9a415db90 2024-05-14T15:16:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.260+0000 7fc9a9200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc9a40d0ee0 0x7fc9a4163a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59858/0 (socket says 172.21.15.2:59858) 2024-05-14T15:16:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.260+0000 7fc9a9200640 1 -- 172.21.15.2:0/662591626 learned_addr learned my addr 172.21.15.2:0/662591626 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:42.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.260+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/662591626 >> v2:172.21.15.156:3300/0 conn(0x7fc9a415db90 0x7fc9a40d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.260+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947281040 0 0) 0x7fc9a40d4810 con 0x7fc9a40d0ee0 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.260+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc98c003520 con 0x7fc9a40d0ee0 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3707223588 0 0) 0x7fc98c003520 con 0x7fc9a40d0ee0 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 >> v2:172.21.15.156:3300/0 conn(0x7fc9a415db90 msgr2=0x7fc9a40d41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 --2- 172.21.15.2:0/662591626 >> v2:172.21.15.156:3300/0 conn(0x7fc9a415db90 0x7fc9a40d41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 >> v1:172.21.15.156:6789/0 conn(0x7fc9a4164120 legacy=0x7fc9a40b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a40d50b0 con 0x7fc9a40d0ee0 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fc9900016f0 con 0x7fc9a40d0ee0 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 >> v1:172.21.15.2:6789/0 conn(0x7fc9a40d0ee0 legacy=0x7fc9a4163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc98c003aa0 0x7fc98c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c004800 0x7fc98c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc98c005350 0x7fc98c00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40d4dd0 con 0x7fc98c003aa0 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00c2e0 con 0x7fc98c004800 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c00c4e0 con 0x7fc98c005350 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc98c003aa0 0x7fc98c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.261+0000 7fc9a9200640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c004800 0x7fc98c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9aa600640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc98c005350 0x7fc98c00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9a9c00640 1 -- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc98c005350 msgr2=0x7fc98c00ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc98c005350 0x7fc98c00ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9a9c00640 1 -- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c004800 msgr2=0x7fc98c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c004800 0x7fc98c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9a9c00640 1 -- 172.21.15.2:0/662591626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c003520 con 0x7fc98c003aa0 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9a9200640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c004800 0x7fc98c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.262+0000 7fc9aa600640 1 -- 172.21.15.2:0/662591626 reap_dead start 2024-05-14T15:16:42.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.263+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc98c003aa0 0x7fc98c003f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc998009a90 tx=0x7fc98c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6099856efba9c8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.263+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998036070 con 0x7fc98c003aa0 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.263+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc998031400 con 0x7fc98c003aa0 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.263+0000 7fc9a3e00640 1 -- 172.21.15.2:0/662591626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998009690 con 0x7fc98c003aa0 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 -- 172.21.15.2:0/662591626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc98c003aa0 msgr2=0x7fc98c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc98c003aa0 0x7fc98c003f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc998009a90 tx=0x7fc98c005830 comp rx=0 tx=0).stop 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 -- 172.21.15.2:0/662591626 shutdown_connections 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 --2- 172.21.15.2:0/662591626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc98c003aa0 0x7fc98c003f10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 -- 172.21.15.2:0/662591626 >> 172.21.15.2:0/662591626 conn(0x7fc9a40d6040 msgr2=0x7fc9a40b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 -- 172.21.15.2:0/662591626 shutdown_connections 2024-05-14T15:16:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.264+0000 7fc9ab000640 1 -- 172.21.15.2:0/662591626 wait complete. 2024-05-14T15:16:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.267+0000 7fc9ab000640 1 Processor -- start 2024-05-14T15:16:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.267+0000 7fc9ab000640 1 -- start start 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.268+0000 7fc9ab000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c003aa0 0x7fc9a40cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.268+0000 7fc9ab000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a40ac650 0x7fc9a40aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.268+0000 7fc9ab000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 0x7fc9a40ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.268+0000 7fc9ab000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40d41a0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.268+0000 7fc9ab000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40d1500 con 0x7fc98c003aa0 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.268+0000 7fc9ab000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a40d4320 con 0x7fc9a40ac650 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 0x7fc9a40ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 0x7fc9a40ba370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50846/0 (socket says 172.21.15.2:50846) 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 -- 172.21.15.2:0/3202773724 learned_addr learned my addr 172.21.15.2:0/3202773724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c003aa0 0x7fc9a40cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9a9200640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a40ac650 0x7fc9a40aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 -- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a40ac650 msgr2=0x7fc9a40aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a40ac650 0x7fc9a40aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 -- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c003aa0 msgr2=0x7fc9a40cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c003aa0 0x7fc9a40cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9aa600640 1 -- 172.21.15.2:0/3202773724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a40ba8b0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.269+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c003aa0 0x7fc9a40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.270+0000 7fc9aa600640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 0x7fc9a40ba370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40cff30 tx=0x7fc99c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.270+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c006b50 con 0x7fc9a40b9f60 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.270+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c006cf0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.270+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c003bb0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.270+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a40cc790 con 0x7fc9a40b9f60 2024-05-14T15:16:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.270+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a40ad680 con 0x7fc9a40b9f60 2024-05-14T15:16:42.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.271+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a4050870 con 0x7fc9a40b9f60 2024-05-14T15:16:42.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.273+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc99c005070 con 0x7fc9a40b9f60 2024-05-14T15:16:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.274+0000 7fc9a1600640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9840762d0 0x7fc9840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.274+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fc99c0971e0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.275+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9840762d0 0x7fc9840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.276+0000 7fc9a9c00640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9840762d0 0x7fc9840787e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc998033000 tx=0x7fc998008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.279+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc9a40ba8b0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.491+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc9a40d3d50 con 0x7fc9a40b9f60 2024-05-14T15:16:42.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.492+0000 7fc9a1600640 1 -- 172.21.15.2:0/3202773724 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fc99c0606a0 con 0x7fc9a40b9f60 2024-05-14T15:16:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-05-14T15:16:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.494+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9840762d0 msgr2=0x7fc9840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.494+0000 7fc9ab000640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9840762d0 0x7fc9840787e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc998033000 tx=0x7fc998008030 comp rx=0 tx=0).stop 2024-05-14T15:16:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.494+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 msgr2=0x7fc9a40ba370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.494+0000 7fc9ab000640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 0x7fc9a40ba370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40cff30 tx=0x7fc99c00ec10 comp rx=0 tx=0).stop 2024-05-14T15:16:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 shutdown_connections 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9840762d0 0x7fc9840787e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9a40b9f60 0x7fc9a40ba370 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a40ac650 0x7fc9a40aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 --2- 172.21.15.2:0/3202773724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc98c003aa0 0x7fc9a40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 >> 172.21.15.2:0/3202773724 conn(0x7fc9a40d6040 msgr2=0x7fc9a4162240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 shutdown_connections 2024-05-14T15:16:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.495+0000 7fc9ab000640 1 -- 172.21.15.2:0/3202773724 wait complete. 2024-05-14T15:16:42.523 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-14T15:16:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.808+0000 7f0967e00640 1 Processor -- start 2024-05-14T15:16:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.808+0000 7f0967e00640 1 -- start start 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0967e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f09680d0d40 0x7f0968070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0967e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0968070b50 con 0x7f0968146020 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0967e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09680afab0 con 0x7f0968070740 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0967e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f09680d1150 con 0x7f09680d0d40 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0966a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0968146020 0x7f09680af160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59862/0 (socket says 172.21.15.2:59862) 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0966a00640 1 -- 172.21.15.2:0/4235441113 learned_addr learned my addr 172.21.15.2:0/4235441113 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.810+0000 7f0966000640 1 --2- 172.21.15.2:0/4235441113 >> v2:172.21.15.2:3300/0 conn(0x7f09680d0d40 0x7f0968070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.811+0000 7f0965600640 1 -- 172.21.15.2:0/4235441113 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607566238 0 0) 0x7f0958001110 con 0x7f0968146020 2024-05-14T15:16:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.811+0000 7f0965600640 1 -- 172.21.15.2:0/4235441113 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f094c005730 con 0x7f0968146020 2024-05-14T15:16:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.811+0000 7f0966000640 1 -- 172.21.15.2:0/4235441113 >> v1:172.21.15.156:6789/0 conn(0x7f0968070740 legacy=0x7f09680b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.811+0000 7f0966000640 1 -- 172.21.15.2:0/4235441113 >> v1:172.21.15.2:6789/0 conn(0x7f0968146020 legacy=0x7f09680af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.811+0000 7f0966000640 1 -- 172.21.15.2:0/4235441113 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680afd90 con 0x7f09680d0d40 2024-05-14T15:16:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.812+0000 7f0966000640 1 --2- 172.21.15.2:0/4235441113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09680d0d40 0x7f0968070200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f095002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac7d25c5e6a7e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.812+0000 7f0965600640 1 -- 172.21.15.2:0/4235441113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950037070 con 0x7f09680d0d40 2024-05-14T15:16:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.812+0000 7f0965600640 1 -- 172.21.15.2:0/4235441113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095002adb0 con 0x7f09680d0d40 2024-05-14T15:16:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.812+0000 7f0965600640 1 -- 172.21.15.2:0/4235441113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950032660 con 0x7f09680d0d40 2024-05-14T15:16:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 -- 172.21.15.2:0/4235441113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09680d0d40 msgr2=0x7f0968070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 --2- 172.21.15.2:0/4235441113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09680d0d40 0x7f0968070200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f095002a060 comp rx=0 tx=0).stop 2024-05-14T15:16:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 -- 172.21.15.2:0/4235441113 shutdown_connections 2024-05-14T15:16:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 --2- 172.21.15.2:0/4235441113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09680d0d40 0x7f0968070200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 -- 172.21.15.2:0/4235441113 >> 172.21.15.2:0/4235441113 conn(0x7f09680739a0 msgr2=0x7f0968073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:42.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 -- 172.21.15.2:0/4235441113 shutdown_connections 2024-05-14T15:16:42.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.813+0000 7f0967e00640 1 -- 172.21.15.2:0/4235441113 wait complete. 2024-05-14T15:16:42.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.816+0000 7f0967e00640 1 Processor -- start 2024-05-14T15:16:42.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.816+0000 7f0967e00640 1 -- start start 2024-05-14T15:16:42.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0967e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 0x7f09681e89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0967e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0968146020 0x7f0968143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0967e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09681eae20 0x7f096809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0967e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09680b4b10 con 0x7f0968070740 2024-05-14T15:16:42.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0967e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f09680af870 con 0x7f0968146020 2024-05-14T15:16:42.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0967e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f09680b0070 con 0x7f09681eae20 2024-05-14T15:16:42.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.817+0000 7f0966a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 0x7f09681e89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 0x7f09681e89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50858/0 (socket says 172.21.15.2:50858) 2024-05-14T15:16:42.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 -- 172.21.15.2:0/1678500188 learned_addr learned my addr 172.21.15.2:0/1678500188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966000640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0968146020 0x7f0968143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0967400640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09681eae20 0x7f096809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 -- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09681eae20 msgr2=0x7f096809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09681eae20 0x7f096809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 -- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0968146020 msgr2=0x7f0968143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0968146020 0x7f0968143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0966a00640 1 -- 172.21.15.2:0/1678500188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09681e9d80 con 0x7f0968070740 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.818+0000 7f0967400640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09681eae20 0x7f096809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.819+0000 7f0966a00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 0x7f09681e89d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f095800c760 tx=0x7f095800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.819+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958017070 con 0x7f0968070740 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.819+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958005ab0 con 0x7f0968070740 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.819+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09681ea060 con 0x7f0968070740 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.819+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958001d10 con 0x7f0968070740 2024-05-14T15:16:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.819+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09681ea620 con 0x7f0968070740 2024-05-14T15:16:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.820+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0968050870 con 0x7f0968070740 2024-05-14T15:16:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.821+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f095801a070 con 0x7f0968070740 2024-05-14T15:16:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.822+0000 7f095ea00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0944076300 0x7f0944078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.823+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f0958096c60 con 0x7f0968070740 2024-05-14T15:16:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.823+0000 7f0966000640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0944076300 0x7f0944078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.824+0000 7f0966000640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0944076300 0x7f0944078810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0950034000 tx=0x7f095002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:42.827+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0968070b50 con 0x7f0968070740 2024-05-14T15:16:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.040+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f096806f0f0 con 0x7f0968070740 2024-05-14T15:16:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.040+0000 7f095ea00640 1 -- 172.21.15.2:0/1678500188 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f09580601c0 con 0x7f0968070740 2024-05-14T15:16:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0944076300 msgr2=0x7f0944078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0944076300 0x7f0944078810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0950034000 tx=0x7f095002e000 comp rx=0 tx=0).stop 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 msgr2=0x7f09681e89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 0x7f09681e89d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f095800c760 tx=0x7f095800cc20 comp rx=0 tx=0).stop 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 shutdown_connections 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0944076300 0x7f0944078810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0968146020 0x7f0968143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09681eae20 0x7f096809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 --2- 172.21.15.2:0/1678500188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0968070740 0x7f09681e89d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 >> 172.21.15.2:0/1678500188 conn(0x7f09680739a0 msgr2=0x7f09680cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 shutdown_connections 2024-05-14T15:16:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.043+0000 7f0967e00640 1 -- 172.21.15.2:0/1678500188 wait complete. 2024-05-14T15:16:43.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-05-14T15:16:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.356+0000 7f972de00640 1 Processor -- start 2024-05-14T15:16:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.356+0000 7f972de00640 1 -- start start 2024-05-14T15:16:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.358+0000 7f972de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f972815bb90 0x7f972815e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.358+0000 7f972de00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97280d1460 con 0x7f972806d700 2024-05-14T15:16:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.358+0000 7f972de00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972815ed90 con 0x7f9728071530 2024-05-14T15:16:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.358+0000 7f972de00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f972815f350 con 0x7f972815bb90 2024-05-14T15:16:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.358+0000 7f9727400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f972806d700 0x7f972806db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59876/0 (socket says 172.21.15.2:59876) 2024-05-14T15:16:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.358+0000 7f9727400640 1 -- 172.21.15.2:0/2247862859 learned_addr learned my addr 172.21.15.2:0/2247862859 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9726a00640 1 --2- 172.21.15.2:0/2247862859 >> v2:172.21.15.156:3300/0 conn(0x7f972815bb90 0x7f972815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022291239 0 0) 0x7f97280d1460 con 0x7f972806d700 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f970c003520 con 0x7f972806d700 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1900055724 0 0) 0x7f970c003520 con 0x7f972806d700 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 >> v2:172.21.15.156:3300/0 conn(0x7f972815bb90 msgr2=0x7f972815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 --2- 172.21.15.2:0/2247862859 >> v2:172.21.15.156:3300/0 conn(0x7f972815bb90 0x7f972815e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 >> v1:172.21.15.156:6789/0 conn(0x7f9728071530 legacy=0x7f97280af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972815f070 con 0x7f972806d700 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f9720001a70 con 0x7f972806d700 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 >> v1:172.21.15.2:6789/0 conn(0x7f972806d700 legacy=0x7f972806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c003aa0 0x7f970c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c004800 0x7f970c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.359+0000 7f9725600640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f970c0053f0 0x7f970c00bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f972815f350 con 0x7f970c0053f0 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f970c00c390 con 0x7f970c004800 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f970c00c590 con 0x7f970c003aa0 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9727400640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f970c0053f0 0x7f970c00bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9726000640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c004800 0x7f970c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9726a00640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c003aa0 0x7f970c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9727400640 1 -- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c003aa0 msgr2=0x7f970c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9727400640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c003aa0 0x7f970c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9727400640 1 -- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c004800 msgr2=0x7f970c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9727400640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c004800 0x7f970c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.360+0000 7f9727400640 1 -- 172.21.15.2:0/2247862859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c003520 con 0x7f970c0053f0 2024-05-14T15:16:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.361+0000 7f9727400640 1 -- 172.21.15.2:0/2247862859 reap_dead start 2024-05-14T15:16:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.362+0000 7f9727400640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f970c0053f0 0x7f970c00bab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f972000a800 tx=0x7f970c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afe7d25279acb18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.362+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972000a450 con 0x7f970c0053f0 2024-05-14T15:16:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.362+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972002f070 con 0x7f970c0053f0 2024-05-14T15:16:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.362+0000 7f9725600640 1 -- 172.21.15.2:0/2247862859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972002bba0 con 0x7f970c0053f0 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 -- 172.21.15.2:0/2247862859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f970c0053f0 msgr2=0x7f970c00bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f970c0053f0 0x7f970c00bab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f972000a800 tx=0x7f970c005830 comp rx=0 tx=0).stop 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 -- 172.21.15.2:0/2247862859 shutdown_connections 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 --2- 172.21.15.2:0/2247862859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f970c0053f0 0x7f970c00bab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 -- 172.21.15.2:0/2247862859 >> 172.21.15.2:0/2247862859 conn(0x7f97280d1d10 msgr2=0x7f97280734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 -- 172.21.15.2:0/2247862859 shutdown_connections 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.363+0000 7f972de00640 1 -- 172.21.15.2:0/2247862859 wait complete. 2024-05-14T15:16:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.365+0000 7f972de00640 1 Processor -- start 2024-05-14T15:16:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.365+0000 7f972de00640 1 -- start start 2024-05-14T15:16:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f972de00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97280b5080 0x7f9728143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f972de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97281f9880 0x7f97281f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f972de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 0x7f9728146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f972de00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f972806db10 con 0x7f97281fa1d0 2024-05-14T15:16:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f972de00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f97280aeb60 con 0x7f97281f9880 2024-05-14T15:16:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f972de00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f972806dc90 con 0x7f97280b5080 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f9727400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 0x7f9728146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f9727400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 0x7f9728146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50880/0 (socket says 172.21.15.2:50880) 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.367+0000 7f9727400640 1 -- 172.21.15.2:0/26004189 learned_addr learned my addr 172.21.15.2:0/26004189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9726a00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97280b5080 0x7f9728143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9726000640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97281f9880 0x7f97281f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9727400640 1 -- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97280b5080 msgr2=0x7f9728143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9727400640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97280b5080 0x7f9728143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9727400640 1 -- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97281f9880 msgr2=0x7f97281f9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9727400640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97281f9880 0x7f97281f9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9727400640 1 -- 172.21.15.2:0/26004189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9728143d70 con 0x7f97281fa1d0 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9726a00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97280b5080 0x7f9728143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:43.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f9727400640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 0x7f9728146090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f972000a800 tx=0x7f9720001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.368+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972000a450 con 0x7f97281fa1d0 2024-05-14T15:16:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.369+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720034470 con 0x7f97281fa1d0 2024-05-14T15:16:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.369+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97280b5830 con 0x7f97281fa1d0 2024-05-14T15:16:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.369+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720001f70 con 0x7f97281fa1d0 2024-05-14T15:16:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.369+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97280b5df0 con 0x7f97281fa1d0 2024-05-14T15:16:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.370+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972806e020 con 0x7f97281fa1d0 2024-05-14T15:16:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.371+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9720034820 con 0x7f97281fa1d0 2024-05-14T15:16:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.372+0000 7f971f400640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f97080762d0 0x7f97080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.372+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f97200b7c40 con 0x7f97281fa1d0 2024-05-14T15:16:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.373+0000 7f9726a00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f97080762d0 0x7f97080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:43.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.374+0000 7f9726a00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f97080762d0 0x7f97080787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f972815aac0 tx=0x7f9718008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.377+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f972806e020 con 0x7f97281fa1d0 2024-05-14T15:16:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:43.671+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7f97280d2640 con 0x7f97281fa1d0 2024-05-14T15:16:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.032+0000 7f971f400640 1 -- 172.21.15.2:0/26004189 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v71) ==== 123+0+0 (secure 0 0 0) 0x7f9720081220 con 0x7f97281fa1d0 2024-05-14T15:16:44.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.035+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f97080762d0 msgr2=0x7f97080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.035+0000 7f972de00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f97080762d0 0x7f97080787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f972815aac0 tx=0x7f9718008040 comp rx=0 tx=0).stop 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 msgr2=0x7f9728146090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 0x7f9728146090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f972000a800 tx=0x7f9720001cb0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 shutdown_connections 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f97080762d0 0x7f97080787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97281f9880 0x7f97281f9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97281fa1d0 0x7f9728146090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 --2- 172.21.15.2:0/26004189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97280b5080 0x7f9728143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 >> 172.21.15.2:0/26004189 conn(0x7f97280d1d10 msgr2=0x7f972815d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 shutdown_connections 2024-05-14T15:16:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.036+0000 7f972de00640 1 -- 172.21.15.2:0/26004189 wait complete. 2024-05-14T15:16:44.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-14T15:16:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.363+0000 7f589f000640 1 Processor -- start 2024-05-14T15:16:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.363+0000 7f589f000640 1 -- start start 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589f000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58980b0920 0x7f58980d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589f000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5898160eb0 0x7f589806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589f000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5898145c40 con 0x7f5898145660 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589f000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f589806f220 con 0x7f58980b0920 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589f000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5898145f20 con 0x7f5898160eb0 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58980b0920 0x7f58980d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58980b0920 0x7f58980d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50882/0 (socket says 172.21.15.2:50882) 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589d200640 1 -- 172.21.15.2:0/1443564403 learned_addr learned my addr 172.21.15.2:0/1443564403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.366+0000 7f589dc00640 1 --1- 172.21.15.2:0/1443564403 >> v1:172.21.15.2:6789/0 conn(0x7f5898145660 0x7f58980b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59882/0 (socket says 172.21.15.2:59882) 2024-05-14T15:16:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.367+0000 7f589e600640 1 --2- 172.21.15.2:0/1443564403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5898160eb0 0x7f589806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.367+0000 7f589d200640 1 -- 172.21.15.2:0/1443564403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5898160eb0 msgr2=0x7f589806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.367+0000 7f589d200640 1 --2- 172.21.15.2:0/1443564403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5898160eb0 0x7f589806f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.367+0000 7f589d200640 1 -- 172.21.15.2:0/1443564403 >> v1:172.21.15.2:6789/0 conn(0x7f5898145660 legacy=0x7f58980b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.367+0000 7f589d200640 1 -- 172.21.15.2:0/1443564403 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5898146200 con 0x7f58980b0920 2024-05-14T15:16:44.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.368+0000 7f589d200640 1 --2- 172.21.15.2:0/1443564403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58980b0920 0x7f58980d0dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5884009870 tx=0x7f588402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121bb867eb60da4a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:44.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.368+0000 7f5897e00640 1 -- 172.21.15.2:0/1443564403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884037070 con 0x7f58980b0920 2024-05-14T15:16:44.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.368+0000 7f5897e00640 1 -- 172.21.15.2:0/1443564403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884032440 con 0x7f58980b0920 2024-05-14T15:16:44.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.368+0000 7f5897e00640 1 -- 172.21.15.2:0/1443564403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884032810 con 0x7f58980b0920 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 -- 172.21.15.2:0/1443564403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58980b0920 msgr2=0x7f58980d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 --2- 172.21.15.2:0/1443564403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58980b0920 0x7f58980d0dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5884009870 tx=0x7f588402a250 comp rx=0 tx=0).stop 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 -- 172.21.15.2:0/1443564403 shutdown_connections 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 --2- 172.21.15.2:0/1443564403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5898160eb0 0x7f589806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 --2- 172.21.15.2:0/1443564403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58980b0920 0x7f58980d0dc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 -- 172.21.15.2:0/1443564403 >> 172.21.15.2:0/1443564403 conn(0x7f58980739a0 msgr2=0x7f5898073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:44.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.369+0000 7f589f000640 1 -- 172.21.15.2:0/1443564403 shutdown_connections 2024-05-14T15:16:44.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.370+0000 7f589f000640 1 -- 172.21.15.2:0/1443564403 wait complete. 2024-05-14T15:16:44.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.372+0000 7f589f000640 1 Processor -- start 2024-05-14T15:16:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.372+0000 7f589f000640 1 -- start start 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.373+0000 7f589f000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58980b0920 0x7f58980cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589f000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 0x7f58981320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589f000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898160eb0 0x7f58981e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589f000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f589806fbf0 con 0x7f5898145660 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589f000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f58981612c0 con 0x7f5898160eb0 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589f000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f589806fd70 con 0x7f58980b0920 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 0x7f58981320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 0x7f58981320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50892/0 (socket says 172.21.15.2:50892) 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 -- 172.21.15.2:0/3618907142 learned_addr learned my addr 172.21.15.2:0/3618907142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589dc00640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58980b0920 0x7f58980cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 -- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58980b0920 msgr2=0x7f58980cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58980b0920 0x7f58980cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 -- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898160eb0 msgr2=0x7f58981e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898160eb0 0x7f58981e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589d200640 1 -- 172.21.15.2:0/3618907142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589812c9a0 con 0x7f5898145660 2024-05-14T15:16:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.374+0000 7f589dc00640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58980b0920 0x7f58980cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.375+0000 7f589d200640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 0x7f58981320b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5884000c00 tx=0x7f58840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.375+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884041020 con 0x7f5898145660 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.375+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58840306c0 con 0x7f5898145660 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.375+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58981325f0 con 0x7f5898145660 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.375+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884037040 con 0x7f5898145660 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.375+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589812cf60 con 0x7f5898145660 2024-05-14T15:16:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.376+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58980b4550 con 0x7f5898145660 2024-05-14T15:16:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.378+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5884044020 con 0x7f5898145660 2024-05-14T15:16:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.379+0000 7f5895600640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58780762d0 0x7f58780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.379+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f58840b8270 con 0x7f5898145660 2024-05-14T15:16:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.380+0000 7f589dc00640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58780762d0 0x7f58780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.381+0000 7f589dc00640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58780762d0 0x7f58780787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f588c000fb0 tx=0x7f588c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.384+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58980b4550 con 0x7f5898145660 2024-05-14T15:16:44.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.593+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5898050870 con 0x7f5898145660 2024-05-14T15:16:44.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.599+0000 7f5895600640 1 -- 172.21.15.2:0/3618907142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f588404b030 con 0x7f5898145660 2024-05-14T15:16:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58780762d0 msgr2=0x7f58780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58780762d0 0x7f58780787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f588c000fb0 tx=0x7f588c009040 comp rx=0 tx=0).stop 2024-05-14T15:16:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 msgr2=0x7f58981320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 0x7f58981320b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5884000c00 tx=0x7f58840046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 shutdown_connections 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58780762d0 0x7f58780787e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898160eb0 0x7f58981e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898145660 0x7f58981320b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 --2- 172.21.15.2:0/3618907142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58980b0920 0x7f58980cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 >> 172.21.15.2:0/3618907142 conn(0x7f58980739a0 msgr2=0x7f589815dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.602+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 shutdown_connections 2024-05-14T15:16:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:44.603+0000 7f589f000640 1 -- 172.21.15.2:0/3618907142 wait complete. 2024-05-14T15:16:44.628 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-14T15:16:44.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T15:16:44.733 DEBUG:teuthology.orchestra.run.smithi156:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T15:16:44.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-14T15:16:44.843 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:16:44.843 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:44.904 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:16:44.904 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:44.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.248+0000 7fc298a00640 1 Processor -- start 2024-05-14T15:16:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.248+0000 7fc298a00640 1 -- start start 2024-05-14T15:16:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.250+0000 7fc298a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2940d3170 0x7fc29415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.250+0000 7fc298a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc294164570 0x7fc2940cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc298a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d0000 0x7fc2940d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc298a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc294160460 con 0x7fc2940d3170 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc298a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940b7eb0 con 0x7fc294164570 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc298a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940ce2f0 con 0x7fc2940d0000 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc293400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2940d3170 0x7fc29415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc293400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2940d3170 0x7fc29415ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50896/0 (socket says 172.21.15.2:50896) 2024-05-14T15:16:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc293400640 1 -- 172.21.15.2:0/4108682129 learned_addr learned my addr 172.21.15.2:0/4108682129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc293e00640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d0000 0x7fc2940d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.251+0000 7fc292a00640 1 --2- 172.21.15.2:0/4108682129 >> v2:172.21.15.156:3300/0 conn(0x7fc294164570 0x7fc2940cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.252+0000 7fc293400640 1 -- 172.21.15.2:0/4108682129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d0000 msgr2=0x7fc2940d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.252+0000 7fc293400640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d0000 0x7fc2940d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.252+0000 7fc293400640 1 -- 172.21.15.2:0/4108682129 >> v2:172.21.15.156:3300/0 conn(0x7fc294164570 msgr2=0x7fc2940cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.252+0000 7fc293400640 1 --2- 172.21.15.2:0/4108682129 >> v2:172.21.15.156:3300/0 conn(0x7fc294164570 0x7fc2940cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.252+0000 7fc293400640 1 -- 172.21.15.2:0/4108682129 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940b7b80 con 0x7fc2940d3170 2024-05-14T15:16:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.252+0000 7fc293e00640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d0000 0x7fc2940d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.253+0000 7fc293400640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d3170 0x7fc29415ff20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc29408cb10 tx=0x7fc28402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7715ce0814bd68b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.253+0000 7fc292000640 1 -- 172.21.15.2:0/4108682129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284037070 con 0x7fc2940d3170 2024-05-14T15:16:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.253+0000 7fc292000640 1 -- 172.21.15.2:0/4108682129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc284032440 con 0x7fc2940d3170 2024-05-14T15:16:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.253+0000 7fc292000640 1 -- 172.21.15.2:0/4108682129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284032810 con 0x7fc2940d3170 2024-05-14T15:16:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 -- 172.21.15.2:0/4108682129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d3170 msgr2=0x7fc29415ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d3170 0x7fc29415ff20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc29408cb10 tx=0x7fc28402a180 comp rx=0 tx=0).stop 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 -- 172.21.15.2:0/4108682129 shutdown_connections 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d0000 0x7fc2940d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 --2- 172.21.15.2:0/4108682129 >> v2:172.21.15.156:3300/0 conn(0x7fc294164570 0x7fc2940cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 --2- 172.21.15.2:0/4108682129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d3170 0x7fc29415ff20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.254+0000 7fc298a00640 1 -- 172.21.15.2:0/4108682129 >> 172.21.15.2:0/4108682129 conn(0x7fc2940b52b0 msgr2=0x7fc2940b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.255+0000 7fc298a00640 1 -- 172.21.15.2:0/4108682129 shutdown_connections 2024-05-14T15:16:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.255+0000 7fc298a00640 1 -- 172.21.15.2:0/4108682129 wait complete. 2024-05-14T15:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.257+0000 7fc298a00640 1 Processor -- start 2024-05-14T15:16:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.257+0000 7fc298a00640 1 -- start start 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc298a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 0x7fc29415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc298a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d3170 0x7fc2941e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc298a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc294164570 0x7fc2940ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc298a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940d0d30 con 0x7fc2940d0000 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc298a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940cfd20 con 0x7fc294164570 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc298a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940d0eb0 con 0x7fc2940d3170 2024-05-14T15:16:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 0x7fc29415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 0x7fc29415eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50902/0 (socket says 172.21.15.2:50902) 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 -- 172.21.15.2:0/3594411255 learned_addr learned my addr 172.21.15.2:0/3594411255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 -- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d3170 msgr2=0x7fc2941e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d3170 0x7fc2941e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 -- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc294164570 msgr2=0x7fc2940ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.259+0000 7fc293400640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc294164570 0x7fc2940ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.260+0000 7fc293400640 1 -- 172.21.15.2:0/3594411255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2941ea420 con 0x7fc2940d0000 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.260+0000 7fc293400640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 0x7fc29415eea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc28402a1c0 tx=0x7fc2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.260+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284041020 con 0x7fc2940d0000 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.260+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840306c0 con 0x7fc2940d0000 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.260+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284037040 con 0x7fc2940d0000 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.260+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2941ea700 con 0x7fc2940d0000 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.261+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2941eacc0 con 0x7fc2940d0000 2024-05-14T15:16:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.262+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294050870 con 0x7fc2940d0000 2024-05-14T15:16:45.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.266+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc284044020 con 0x7fc2940d0000 2024-05-14T15:16:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.267+0000 7fc28b400640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2700762d0 0x7fc2700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.267+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fc2840b8180 con 0x7fc2940d0000 2024-05-14T15:16:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.267+0000 7fc292a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2700762d0 0x7fc2700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.269+0000 7fc292a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2700762d0 0x7fc2700787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc294163d10 tx=0x7fc27c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:45.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.272+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc28404b030 con 0x7fc2940d0000 2024-05-14T15:16:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.499+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2940b6640 con 0x7fc2940d0000 2024-05-14T15:16:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.500+0000 7fc28b400640 1 -- 172.21.15.2:0/3594411255 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fc284081770 con 0x7fc2940d0000 2024-05-14T15:16:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2700762d0 msgr2=0x7fc2700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2700762d0 0x7fc2700787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc294163d10 tx=0x7fc27c008040 comp rx=0 tx=0).stop 2024-05-14T15:16:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 msgr2=0x7fc29415eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 0x7fc29415eea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc28402a1c0 tx=0x7fc2840046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 shutdown_connections 2024-05-14T15:16:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2700762d0 0x7fc2700787e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc294164570 0x7fc2940ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2940d3170 0x7fc2941e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 --2- 172.21.15.2:0/3594411255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2940d0000 0x7fc29415eea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.503+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 >> 172.21.15.2:0/3594411255 conn(0x7fc2940b52b0 msgr2=0x7fc2940b8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.504+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 shutdown_connections 2024-05-14T15:16:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.504+0000 7fc298a00640 1 -- 172.21.15.2:0/3594411255 wait complete. 2024-05-14T15:16:45.530 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:16:45.530 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:45.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.877+0000 7f89a0a00640 1 Processor -- start 2024-05-14T15:16:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.877+0000 7f89a0a00640 1 -- start start 2024-05-14T15:16:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.879+0000 7f89a0a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f899c0d0ff0 0x7f899c1625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.879+0000 7f89a0a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 0x7f899c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.879+0000 7f89a0a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f899c0b5130 con 0x7f899c0cfb40 2024-05-14T15:16:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.879+0000 7f89a0a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f899c15f5b0 con 0x7f899c0d0ff0 2024-05-14T15:16:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.879+0000 7f89a0a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f899c15e7f0 con 0x7f899c0b47e0 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.880+0000 7f899a800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f899c0cfb40 0x7f899c0cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59888/0 (socket says 172.21.15.2:59888) 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.880+0000 7f899a800640 1 -- 172.21.15.2:0/2264646884 learned_addr learned my addr 172.21.15.2:0/2264646884 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.880+0000 7f8999400640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 0x7f899c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.880+0000 7f8999e00640 1 --2- 172.21.15.2:0/2264646884 >> v2:172.21.15.156:3300/0 conn(0x7f899c0d0ff0 0x7f899c1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.880+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028199826 0 0) 0x7f8994001490 con 0x7f899c0cfb40 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.880+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8980003520 con 0x7f899c0cfb40 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 773050814 0 0) 0x7f8980003520 con 0x7f899c0cfb40 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 msgr2=0x7f899c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 0x7f899c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 >> v2:172.21.15.156:3300/0 conn(0x7f899c0d0ff0 msgr2=0x7f899c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 --2- 172.21.15.2:0/2264646884 >> v2:172.21.15.156:3300/0 conn(0x7f899c0d0ff0 0x7f899c1625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c15ead0 con 0x7f899c0cfb40 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f8994001c40 con 0x7f899c0cfb40 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 >> v1:172.21.15.2:6789/0 conn(0x7f899c0cfb40 legacy=0x7f899c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980003a50 0x7f8980003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 0x7f8980004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8980004d40 0x7f8980005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f899c15f5b0 con 0x7f8980004d40 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f899c15e7f0 con 0x7f8980003a50 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f898000baa0 con 0x7f899c0b47e0 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.881+0000 7f899a800640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8980004d40 0x7f8980005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f8999e00640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980003a50 0x7f8980003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f8999400640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 0x7f8980004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f899a800640 1 -- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 msgr2=0x7f8980004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f899a800640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f899c0b47e0 0x7f8980004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f899a800640 1 -- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980003a50 msgr2=0x7f8980003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f899a800640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980003a50 0x7f8980003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.882+0000 7f899a800640 1 -- 172.21.15.2:0/2264646884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8980003520 con 0x7f8980004d40 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.883+0000 7f899a800640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8980004d40 0x7f8980005150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f899c073490 tx=0x7f8980005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1989c704e2d3b52 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.883+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400a600 con 0x7f8980004d40 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.883+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899402f070 con 0x7f8980004d40 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.883+0000 7f8998a00640 1 -- 172.21.15.2:0/2264646884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899402bd40 con 0x7f8980004d40 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f89a0a00640 1 -- 172.21.15.2:0/2264646884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8980004d40 msgr2=0x7f8980005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f89a0a00640 1 --2- 172.21.15.2:0/2264646884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8980004d40 0x7f8980005150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f899c073490 tx=0x7f8980005830 comp rx=0 tx=0).stop 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f899a800640 1 -- 172.21.15.2:0/2264646884 reap_dead start 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f89a0a00640 1 -- 172.21.15.2:0/2264646884 shutdown_connections 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f89a0a00640 1 -- 172.21.15.2:0/2264646884 >> 172.21.15.2:0/2264646884 conn(0x7f899c0ce230 msgr2=0x7f899c0ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f89a0a00640 1 -- 172.21.15.2:0/2264646884 shutdown_connections 2024-05-14T15:16:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.884+0000 7f89a0a00640 1 -- 172.21.15.2:0/2264646884 wait complete. 2024-05-14T15:16:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.887+0000 7f89a0a00640 1 Processor -- start 2024-05-14T15:16:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.887+0000 7f89a0a00640 1 -- start start 2024-05-14T15:16:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f89a0a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8980004d40 0x7f899c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f89a0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f899c1e9b40 0x7f899c1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f89a0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 0x7f899c1606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f89a0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f899c071640 con 0x7f899c1560c0 2024-05-14T15:16:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f89a0a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f899c15f090 con 0x7f899c1e9b40 2024-05-14T15:16:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f89a0a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f899c06d700 con 0x7f8980004d40 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f899a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 0x7f899c1606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f899a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 0x7f899c1606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50920/0 (socket says 172.21.15.2:50920) 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f899a800640 1 -- 172.21.15.2:0/233470569 learned_addr learned my addr 172.21.15.2:0/233470569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f8999400640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f899c1e9b40 0x7f899c1601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.889+0000 7f8999e00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8980004d40 0x7f899c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f899a800640 1 -- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8980004d40 msgr2=0x7f899c154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f899a800640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8980004d40 0x7f899c154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f899a800640 1 -- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f899c1e9b40 msgr2=0x7f899c1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f899a800640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f899c1e9b40 0x7f899c1601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f899a800640 1 -- 172.21.15.2:0/233470569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c0b0680 con 0x7f899c1560c0 2024-05-14T15:16:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f8999e00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8980004d40 0x7f899c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f899a800640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 0x7f899c1606f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f899400aaa0 tx=0x7f8994001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400a600 con 0x7f899c1560c0 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8994004d70 con 0x7f899c1560c0 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c0aea10 con 0x7f899c1560c0 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899402bb00 con 0x7f899c1560c0 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.890+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c0aefd0 con 0x7f899c1560c0 2024-05-14T15:16:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.892+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c0b2490 con 0x7f899c1560c0 2024-05-14T15:16:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.893+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f899403e030 con 0x7f899c1560c0 2024-05-14T15:16:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.894+0000 7f8992000640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8978076300 0x7f8978078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.894+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f89940b71c0 con 0x7f899c1560c0 2024-05-14T15:16:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.895+0000 7f8999e00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8978076300 0x7f8978078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.896+0000 7f8999e00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8978076300 0x7f8978078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f899c0cde50 tx=0x7f898c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:45.899+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f899c0b5130 con 0x7f899c1560c0 2024-05-14T15:16:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.122+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f899c0cf140 con 0x7f899c1560c0 2024-05-14T15:16:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.123+0000 7f8992000640 1 -- 172.21.15.2:0/233470569 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f8994080680 con 0x7f899c1560c0 2024-05-14T15:16:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8978076300 msgr2=0x7f8978078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8978076300 0x7f8978078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f899c0cde50 tx=0x7f898c008040 comp rx=0 tx=0).stop 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 msgr2=0x7f899c1606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 0x7f899c1606f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f899400aaa0 tx=0x7f8994001e80 comp rx=0 tx=0).stop 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 shutdown_connections 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8978076300 0x7f8978078810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f899c1e9b40 0x7f899c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f899c1560c0 0x7f899c1606f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 --2- 172.21.15.2:0/233470569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8980004d40 0x7f899c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 >> 172.21.15.2:0/233470569 conn(0x7f899c0ce230 msgr2=0x7f899c15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.125+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 shutdown_connections 2024-05-14T15:16:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.126+0000 7f89a0a00640 1 -- 172.21.15.2:0/233470569 wait complete. 2024-05-14T15:16:46.154 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-05-14T15:16:46.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:46.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-14T15:16:46.240 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:46.240 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:16:46.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:46.241 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T15:16:46.295 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:16:46.295 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:46.354 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:16:46.354 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:46.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.709+0000 7fd249400640 1 Processor -- start 2024-05-14T15:16:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.709+0000 7fd249400640 1 -- start start 2024-05-14T15:16:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd249400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 0x7fd2440d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd249400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd244164120 0x7fd2440b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd249400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2440d4810 con 0x7fd2440d0ee0 2024-05-14T15:16:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd249400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fd2440d4af0 con 0x7fd244164120 2024-05-14T15:16:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd249400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd2440d4dd0 con 0x7fd24415db90 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd243400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2440d0ee0 0x7fd244163a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59890/0 (socket says 172.21.15.2:59890) 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.712+0000 7fd243400640 1 -- 172.21.15.2:0/1639199823 learned_addr learned my addr 172.21.15.2:0/1639199823 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd248a00640 1 --2- 172.21.15.2:0/1639199823 >> v2:172.21.15.156:3300/0 conn(0x7fd244164120 0x7fd2440b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd243e00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 0x7fd2440d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466852748 0 0) 0x7fd2440d4810 con 0x7fd2440d0ee0 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd224003520 con 0x7fd2440d0ee0 2024-05-14T15:16:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1983979235 0 0) 0x7fd224003520 con 0x7fd2440d0ee0 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 msgr2=0x7fd2440d41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 0x7fd2440d41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 >> v2:172.21.15.156:3300/0 conn(0x7fd244164120 msgr2=0x7fd2440b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 --2- 172.21.15.2:0/1639199823 >> v2:172.21.15.156:3300/0 conn(0x7fd244164120 0x7fd2440b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2440d50b0 con 0x7fd2440d0ee0 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fd22c001a70 con 0x7fd2440d0ee0 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 >> v1:172.21.15.2:6789/0 conn(0x7fd2440d0ee0 legacy=0x7fd244163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 0x7fd224003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd224003fd0 0x7fd224004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.713+0000 7fd242a00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd224004d40 0x7fd224005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440d4af0 con 0x7fd224003fd0 2024-05-14T15:16:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440d4dd0 con 0x7fd224004d40 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd22400bb50 con 0x7fd24415db90 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243400640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd224003fd0 0x7fd224004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243400640 1 -- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 msgr2=0x7fd224003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243e00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 0x7fd224003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd248a00640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd224004d40 0x7fd224005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243400640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd24415db90 0x7fd224003a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243400640 1 -- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd224004d40 msgr2=0x7fd224005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243400640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd224004d40 0x7fd224005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.714+0000 7fd243400640 1 -- 172.21.15.2:0/1639199823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd224003520 con 0x7fd224003fd0 2024-05-14T15:16:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.715+0000 7fd243400640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd224003fd0 0x7fd224004800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd22c002230 tx=0x7fd224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318f8bd7c80eaa93 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00a500 con 0x7fd224003fd0 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c02f070 con 0x7fd224003fd0 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd242a00640 1 -- 172.21.15.2:0/1639199823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c02bb10 con 0x7fd224003fd0 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd249400640 1 -- 172.21.15.2:0/1639199823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd224003fd0 msgr2=0x7fd224004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd249400640 1 --2- 172.21.15.2:0/1639199823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd224003fd0 0x7fd224004800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd22c002230 tx=0x7fd224005830 comp rx=0 tx=0).stop 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd248a00640 1 -- 172.21.15.2:0/1639199823 reap_dead start 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd249400640 1 -- 172.21.15.2:0/1639199823 shutdown_connections 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.716+0000 7fd249400640 1 -- 172.21.15.2:0/1639199823 >> 172.21.15.2:0/1639199823 conn(0x7fd2440d6040 msgr2=0x7fd2440b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.717+0000 7fd249400640 1 -- 172.21.15.2:0/1639199823 shutdown_connections 2024-05-14T15:16:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.717+0000 7fd249400640 1 -- 172.21.15.2:0/1639199823 wait complete. 2024-05-14T15:16:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.719+0000 7fd249400640 1 Processor -- start 2024-05-14T15:16:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.719+0000 7fd249400640 1 -- start start 2024-05-14T15:16:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd249400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd224003fd0 0x7fd24415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd249400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2440ba500 0x7fd2440b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd249400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 0x7fd2440b9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd249400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440d41a0 con 0x7fd2440b9320 2024-05-14T15:16:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd249400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440d1500 con 0x7fd2440ba500 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd249400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd2440d4320 con 0x7fd224003fd0 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd248a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 0x7fd2440b9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd248a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 0x7fd2440b9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50940/0 (socket says 172.21.15.2:50940) 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd248a00640 1 -- 172.21.15.2:0/285916986 learned_addr learned my addr 172.21.15.2:0/285916986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd243400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2440ba500 0x7fd2440b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd243e00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd224003fd0 0x7fd24415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd248a00640 1 -- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd224003fd0 msgr2=0x7fd24415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.721+0000 7fd248a00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd224003fd0 0x7fd24415a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd248a00640 1 -- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2440ba500 msgr2=0x7fd2440b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd248a00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2440ba500 0x7fd2440b8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd248a00640 1 -- 172.21.15.2:0/285916986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2440cd0e0 con 0x7fd2440b9320 2024-05-14T15:16:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd248a00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 0x7fd2440b9730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2440bb7e0 tx=0x7fd23c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00f040 con 0x7fd2440b9320 2024-05-14T15:16:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c01c070 con 0x7fd2440b9320 2024-05-14T15:16:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2440cd3c0 con 0x7fd2440b9320 2024-05-14T15:16:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00eae0 con 0x7fd2440b9320 2024-05-14T15:16:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.722+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2440cd980 con 0x7fd2440b9320 2024-05-14T15:16:46.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.723+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2440cce50 con 0x7fd2440b9320 2024-05-14T15:16:46.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.725+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd23c00ec80 con 0x7fd2440b9320 2024-05-14T15:16:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.726+0000 7fd23be00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd220076300 0x7fd220078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.726+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fd23c097610 con 0x7fd2440b9320 2024-05-14T15:16:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.727+0000 7fd243e00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd220076300 0x7fd220078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.728+0000 7fd243e00640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd220076300 0x7fd220078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd234009160 tx=0x7fd234008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.731+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd23c026020 con 0x7fd2440b9320 2024-05-14T15:16:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.959+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd244050870 con 0x7fd2440b9320 2024-05-14T15:16:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.960+0000 7fd23be00640 1 -- 172.21.15.2:0/285916986 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fd23c060510 con 0x7fd2440b9320 2024-05-14T15:16:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd220076300 msgr2=0x7fd220078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd220076300 0x7fd220078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd234009160 tx=0x7fd234008040 comp rx=0 tx=0).stop 2024-05-14T15:16:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 msgr2=0x7fd2440b9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 0x7fd2440b9730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2440bb7e0 tx=0x7fd23c010c20 comp rx=0 tx=0).stop 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 shutdown_connections 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd220076300 0x7fd220078810 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2440ba500 0x7fd2440b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2440b9320 0x7fd2440b9730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 --2- 172.21.15.2:0/285916986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd224003fd0 0x7fd24415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.962+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 >> 172.21.15.2:0/285916986 conn(0x7fd2440d6040 msgr2=0x7fd24415b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.963+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 shutdown_connections 2024-05-14T15:16:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:46.963+0000 7fd249400640 1 -- 172.21.15.2:0/285916986 wait complete. 2024-05-14T15:16:46.991 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:16:46.991 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:47.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.344+0000 7fb6c3e00640 1 Processor -- start 2024-05-14T15:16:47.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.344+0000 7fb6c3e00640 1 -- start start 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6c40af630 0x7fb6c4161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c3e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c4162150 con 0x7fb6c4161d40 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c3e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c40b0f70 con 0x7fb6c40af630 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c40b0360 con 0x7fb6c40d0740 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c2000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb6c4161d40 0x7fb6c415e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59904/0 (socket says 172.21.15.2:59904) 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c2000640 1 -- 172.21.15.2:0/758641493 learned_addr learned my addr 172.21.15.2:0/758641493 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.347+0000 7fb6c2a00640 1 --2- 172.21.15.2:0/758641493 >> v2:172.21.15.2:3300/0 conn(0x7fb6c40af630 0x7fb6c4161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.348+0000 7fb6c3400640 1 --2- 172.21.15.2:0/758641493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.348+0000 7fb6c2a00640 1 -- 172.21.15.2:0/758641493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 msgr2=0x7fb6c415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.348+0000 7fb6c2a00640 1 --2- 172.21.15.2:0/758641493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.348+0000 7fb6c2a00640 1 -- 172.21.15.2:0/758641493 >> v1:172.21.15.2:6789/0 conn(0x7fb6c4161d40 legacy=0x7fb6c415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:47.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.348+0000 7fb6c2a00640 1 -- 172.21.15.2:0/758641493 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c40b0640 con 0x7fb6c40af630 2024-05-14T15:16:47.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.349+0000 7fb6c2a00640 1 --2- 172.21.15.2:0/758641493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4161800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40097a0 tx=0x7fb6b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da05033f9632141 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:47.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.349+0000 7fb6c1600640 1 -- 172.21.15.2:0/758641493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4037070 con 0x7fb6c40af630 2024-05-14T15:16:47.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.349+0000 7fb6c1600640 1 -- 172.21.15.2:0/758641493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b4032440 con 0x7fb6c40af630 2024-05-14T15:16:47.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.349+0000 7fb6c1600640 1 -- 172.21.15.2:0/758641493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4032810 con 0x7fb6c40af630 2024-05-14T15:16:47.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.350+0000 7fb6c3e00640 1 -- 172.21.15.2:0/758641493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 msgr2=0x7fb6c4161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:47.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.350+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/758641493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4161800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40097a0 tx=0x7fb6b402a180 comp rx=0 tx=0).stop 2024-05-14T15:16:47.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.350+0000 7fb6c3e00640 1 -- 172.21.15.2:0/758641493 shutdown_connections 2024-05-14T15:16:47.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.350+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/758641493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.350+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/758641493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4161800 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.350+0000 7fb6c3e00640 1 -- 172.21.15.2:0/758641493 >> 172.21.15.2:0/758641493 conn(0x7fb6c40739a0 msgr2=0x7fb6c4073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:47.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.351+0000 7fb6c3e00640 1 -- 172.21.15.2:0/758641493 shutdown_connections 2024-05-14T15:16:47.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.351+0000 7fb6c3e00640 1 -- 172.21.15.2:0/758641493 wait complete. 2024-05-14T15:16:47.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.353+0000 7fb6c3e00640 1 Processor -- start 2024-05-14T15:16:47.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.353+0000 7fb6c3e00640 1 -- start start 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c4161d40 0x7fb6c4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4162560 con 0x7fb6c40af630 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c40b0c00 con 0x7fb6c4161d40 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c40afa40 con 0x7fb6c40d0740 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50962/0 (socket says 172.21.15.2:50962) 2024-05-14T15:16:47.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.355+0000 7fb6c2a00640 1 -- 172.21.15.2:0/743714483 learned_addr learned my addr 172.21.15.2:0/743714483 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6c2a00640 1 -- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 msgr2=0x7fb6c4155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6c2a00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6c2a00640 1 -- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c4161d40 msgr2=0x7fb6c4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6c2a00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c4161d40 0x7fb6c4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6c2a00640 1 -- 172.21.15.2:0/743714483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c4151dd0 con 0x7fb6c40af630 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6c2a00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4151890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4035040 tx=0x7fb6b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.356+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4037040 con 0x7fb6c40af630 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.357+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c41566b0 con 0x7fb6c40af630 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.357+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b4042070 con 0x7fb6c40af630 2024-05-14T15:16:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.357+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4030bb0 con 0x7fb6c40af630 2024-05-14T15:16:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.357+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c4156c70 con 0x7fb6c40af630 2024-05-14T15:16:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.358+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c4050870 con 0x7fb6c40af630 2024-05-14T15:16:47.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.359+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6b4047460 con 0x7fb6c40af630 2024-05-14T15:16:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.360+0000 7fb6baa00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6a40762d0 0x7fb6a40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.360+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fb6b40b8470 con 0x7fb6c40af630 2024-05-14T15:16:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.361+0000 7fb6c2000640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6a40762d0 0x7fb6a40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:47.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.362+0000 7fb6c2000640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6a40762d0 0x7fb6a40787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40b6750 tx=0x7fb6b0007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.365+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6b404c020 con 0x7fb6c40af630 2024-05-14T15:16:47.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.598+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6c40b30e0 con 0x7fb6c40af630 2024-05-14T15:16:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.598+0000 7fb6baa00640 1 -- 172.21.15.2:0/743714483 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fb6b40819d0 con 0x7fb6c40af630 2024-05-14T15:16:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6a40762d0 msgr2=0x7fb6a40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6a40762d0 0x7fb6a40787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40b6750 tx=0x7fb6b0007a40 comp rx=0 tx=0).stop 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 msgr2=0x7fb6c4151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4151890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4035040 tx=0x7fb6b40046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 shutdown_connections 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb6a40762d0 0x7fb6a40787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c4161d40 0x7fb6c4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c40d0740 0x7fb6c4155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 --2- 172.21.15.2:0/743714483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c40af630 0x7fb6c4151890 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.601+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 >> 172.21.15.2:0/743714483 conn(0x7fb6c40739a0 msgr2=0x7fb6c4153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.602+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 shutdown_connections 2024-05-14T15:16:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:47.602+0000 7fb6c3e00640 1 -- 172.21.15.2:0/743714483 wait complete. 2024-05-14T15:16:47.626 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi156.front.sepia.ceph.com... 2024-05-14T15:16:47.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:47.627 DEBUG:teuthology.orchestra.run.smithi156:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-14T15:16:47.719 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:47.720 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:16:47.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:47.720 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-14T15:16:47.780 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:16:47.780 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:47.839 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:16:47.839 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:47.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.188+0000 7ff08d400640 1 Processor -- start 2024-05-14T15:16:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.188+0000 7ff08d400640 1 -- start start 2024-05-14T15:16:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.190+0000 7ff08d400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff088161f10 0x7ff0880cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.190+0000 7ff08d400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 0x7ff0880d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.190+0000 7ff08d400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880b0360 con 0x7ff0880af630 2024-05-14T15:16:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.190+0000 7ff08d400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7ff0880b0f70 con 0x7ff088161f10 2024-05-14T15:16:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.190+0000 7ff08d400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880b0640 con 0x7ff0880cfc70 2024-05-14T15:16:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.191+0000 7ff087e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff0880af630 0x7ff088161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59908/0 (socket says 172.21.15.2:59908) 2024-05-14T15:16:48.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.191+0000 7ff087e00640 1 -- 172.21.15.2:0/1198765385 learned_addr learned my addr 172.21.15.2:0/1198765385 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.191+0000 7ff08ca00640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 0x7ff0880d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.191+0000 7ff07fe00640 1 --2- 172.21.15.2:0/1198765385 >> v2:172.21.15.156:3300/0 conn(0x7ff088161f10 0x7ff0880cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.191+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777135549 0 0) 0x7ff0880b0360 con 0x7ff0880af630 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.191+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff06c003520 con 0x7ff0880af630 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3778088558 0 0) 0x7ff06c003520 con 0x7ff0880af630 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 msgr2=0x7ff0880d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 0x7ff0880d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 >> v2:172.21.15.156:3300/0 conn(0x7ff088161f10 msgr2=0x7ff0880cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 --2- 172.21.15.2:0/1198765385 >> v2:172.21.15.156:3300/0 conn(0x7ff088161f10 0x7ff0880cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0880b0920 con 0x7ff0880af630 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7ff0780016f0 con 0x7ff0880af630 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 >> v1:172.21.15.2:6789/0 conn(0x7ff0880af630 legacy=0x7ff088161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c003a50 0x7ff06c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 0x7ff06c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06c004d40 0x7ff06c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880b0f70 con 0x7ff06c003a50 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880b0640 con 0x7ff06c004d40 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c00baa0 con 0x7ff0880cfc70 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.192+0000 7ff087e00640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c003a50 0x7ff06c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.193+0000 7ff08ca00640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06c004d40 0x7ff06c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.193+0000 7ff087e00640 1 -- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 msgr2=0x7ff06c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.193+0000 7ff087e00640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0880cfc70 0x7ff06c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.193+0000 7ff087e00640 1 -- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06c004d40 msgr2=0x7ff06c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.193+0000 7ff087e00640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06c004d40 0x7ff06c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.193+0000 7ff087e00640 1 -- 172.21.15.2:0/1198765385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c003520 con 0x7ff06c003a50 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.194+0000 7ff087e00640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c003a50 0x7ff06c003ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff07800c210 tx=0x7ff06c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881ef3ae2fa6d177 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078007ce0 con 0x7ff06c003a50 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff078005af0 con 0x7ff06c003a50 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff087400640 1 -- 172.21.15.2:0/1198765385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078007070 con 0x7ff06c003a50 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff08d400640 1 -- 172.21.15.2:0/1198765385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c003a50 msgr2=0x7ff06c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff08d400640 1 --2- 172.21.15.2:0/1198765385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c003a50 0x7ff06c003ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff07800c210 tx=0x7ff06c005830 comp rx=0 tx=0).stop 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff08ca00640 1 -- 172.21.15.2:0/1198765385 reap_dead start 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff08d400640 1 -- 172.21.15.2:0/1198765385 shutdown_connections 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.195+0000 7ff08d400640 1 -- 172.21.15.2:0/1198765385 >> 172.21.15.2:0/1198765385 conn(0x7ff0880739a0 msgr2=0x7ff088073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.196+0000 7ff08d400640 1 -- 172.21.15.2:0/1198765385 shutdown_connections 2024-05-14T15:16:48.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.196+0000 7ff08d400640 1 -- 172.21.15.2:0/1198765385 wait complete. 2024-05-14T15:16:48.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.198+0000 7ff08d400640 1 Processor -- start 2024-05-14T15:16:48.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.198+0000 7ff08d400640 1 -- start start 2024-05-14T15:16:48.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.199+0000 7ff08d400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0881481a0 0x7ff08809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.199+0000 7ff08d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff088147ab0 0x7ff088157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.199+0000 7ff08d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 0x7ff088155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.199+0000 7ff08d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880afa40 con 0x7ff088158130 2024-05-14T15:16:48.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.199+0000 7ff08d400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff088162560 con 0x7ff088147ab0 2024-05-14T15:16:48.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.199+0000 7ff08d400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880afbc0 con 0x7ff0881481a0 2024-05-14T15:16:48.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 0x7ff088155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 0x7ff088155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50980/0 (socket says 172.21.15.2:50980) 2024-05-14T15:16:48.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 -- 172.21.15.2:0/935328181 learned_addr learned my addr 172.21.15.2:0/935328181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:48.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff087e00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0881481a0 0x7ff08809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 -- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0881481a0 msgr2=0x7ff08809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0881481a0 0x7ff08809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 -- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff088147ab0 msgr2=0x7ff088157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff088147ab0 0x7ff088157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff08ca00640 1 -- 172.21.15.2:0/935328181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088158540 con 0x7ff088158130 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.200+0000 7ff087e00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0881481a0 0x7ff08809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.201+0000 7ff08ca00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 0x7ff088155060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0880d1590 tx=0x7ff0800115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.201+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080011e10 con 0x7ff088158130 2024-05-14T15:16:48.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.201+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08001b070 con 0x7ff088158130 2024-05-14T15:16:48.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.201+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08809f230 con 0x7ff088158130 2024-05-14T15:16:48.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.201+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080003990 con 0x7ff088158130 2024-05-14T15:16:48.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.201+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08809bdf0 con 0x7ff088158130 2024-05-14T15:16:48.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.202+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0881549f0 con 0x7ff088158130 2024-05-14T15:16:48.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.203+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff080005d10 con 0x7ff088158130 2024-05-14T15:16:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.204+0000 7ff084c00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff0640762d0 0x7ff0640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.204+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7ff080097f30 con 0x7ff088158130 2024-05-14T15:16:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.205+0000 7ff087e00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff0640762d0 0x7ff0640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.206+0000 7ff087e00640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff0640762d0 0x7ff0640787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff078032000 tx=0x7ff078009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:48.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.209+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff0881549f0 con 0x7ff088158130 2024-05-14T15:16:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.421+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0880cfa30 con 0x7ff088158130 2024-05-14T15:16:48.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.422+0000 7ff084c00640 1 -- 172.21.15.2:0/935328181 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7ff0880cfa30 con 0x7ff088158130 2024-05-14T15:16:48.422 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff0640762d0 msgr2=0x7ff0640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff0640762d0 0x7ff0640787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff078032000 tx=0x7ff078009030 comp rx=0 tx=0).stop 2024-05-14T15:16:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 msgr2=0x7ff088155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 0x7ff088155060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0880d1590 tx=0x7ff0800115a0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 shutdown_connections 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff0640762d0 0x7ff0640787e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff088147ab0 0x7ff088157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff088158130 0x7ff088155060 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 --2- 172.21.15.2:0/935328181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0881481a0 0x7ff08809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 >> 172.21.15.2:0/935328181 conn(0x7ff0880739a0 msgr2=0x7ff088161790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 shutdown_connections 2024-05-14T15:16:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.425+0000 7ff08d400640 1 -- 172.21.15.2:0/935328181 wait complete. 2024-05-14T15:16:48.451 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:16:48.451 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:48.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.786+0000 7fb25a800640 1 Processor -- start 2024-05-14T15:16:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.786+0000 7fb25a800640 1 -- start start 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb25a800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb25415fe90 0x7fb25406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb25a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 0x7fb254162940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb25a800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25406d6c0 con 0x7fb25415e040 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb25a800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fb2541624b0 con 0x7fb25415fe90 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb25a800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb2541618a0 con 0x7fb25406d2b0 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb259400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb25415e040 0x7fb2540b7240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59924/0 (socket says 172.21.15.2:59924) 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.789+0000 7fb259400640 1 -- 172.21.15.2:0/4211580408 learned_addr learned my addr 172.21.15.2:0/4211580408 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb258a00640 1 --2- 172.21.15.2:0/4211580408 >> v2:172.21.15.156:3300/0 conn(0x7fb25415fe90 0x7fb25406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb259e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 0x7fb254162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946257058 0 0) 0x7fb248001110 con 0x7fb25415e040 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb23c003520 con 0x7fb25415e040 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039107563 0 0) 0x7fb23c003520 con 0x7fb25415e040 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 msgr2=0x7fb254162940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 0x7fb254162940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 >> v2:172.21.15.156:3300/0 conn(0x7fb25415fe90 msgr2=0x7fb25406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 --2- 172.21.15.2:0/4211580408 >> v2:172.21.15.156:3300/0 conn(0x7fb25415fe90 0x7fb25406cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb254161b80 con 0x7fb25415e040 2024-05-14T15:16:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fb2480018c0 con 0x7fb25415e040 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.790+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 >> v1:172.21.15.2:6789/0 conn(0x7fb25415e040 legacy=0x7fb2540b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb253e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 0x7fb23c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb253e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb23c003fd0 0x7fb23c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb253e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb23c004d40 0x7fb23c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541624b0 con 0x7fb23c004d40 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541618a0 con 0x7fb23c003fd0 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c00bac0 con 0x7fb25406d2b0 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb259e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb23c004d40 0x7fb23c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb258a00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb23c003fd0 0x7fb23c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.791+0000 7fb259400640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 0x7fb23c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.792+0000 7fb259e00640 1 -- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 msgr2=0x7fb23c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.792+0000 7fb259e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25406d2b0 0x7fb23c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.792+0000 7fb259e00640 1 -- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb23c003fd0 msgr2=0x7fb23c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.792+0000 7fb259e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb23c003fd0 0x7fb23c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.792+0000 7fb259e00640 1 -- 172.21.15.2:0/4211580408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c003520 con 0x7fb23c004d40 2024-05-14T15:16:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.792+0000 7fb258a00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb23c003fd0 0x7fb23c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.793+0000 7fb259e00640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb23c004d40 0x7fb23c005150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009fc0 tx=0x7fb23c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de340e84de80c9b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.793+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c034020 con 0x7fb23c004d40 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.793+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c0305f0 con 0x7fb23c004d40 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.793+0000 7fb253e00640 1 -- 172.21.15.2:0/4211580408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c009c10 con 0x7fb23c004d40 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb25a800640 1 -- 172.21.15.2:0/4211580408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb23c004d40 msgr2=0x7fb23c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb25a800640 1 --2- 172.21.15.2:0/4211580408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb23c004d40 0x7fb23c005150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009fc0 tx=0x7fb23c005830 comp rx=0 tx=0).stop 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb259e00640 1 -- 172.21.15.2:0/4211580408 reap_dead start 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb25a800640 1 -- 172.21.15.2:0/4211580408 shutdown_connections 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb25a800640 1 -- 172.21.15.2:0/4211580408 >> 172.21.15.2:0/4211580408 conn(0x7fb254073d50 msgr2=0x7fb25409b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb25a800640 1 -- 172.21.15.2:0/4211580408 shutdown_connections 2024-05-14T15:16:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.794+0000 7fb25a800640 1 -- 172.21.15.2:0/4211580408 wait complete. 2024-05-14T15:16:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.797+0000 7fb25a800640 1 Processor -- start 2024-05-14T15:16:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.797+0000 7fb25a800640 1 -- start start 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.798+0000 7fb25a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb23c004d40 0x7fb254144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.798+0000 7fb25a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb254141270 0x7fb254141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.798+0000 7fb25a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 0x7fb2541f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb25a800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541602a0 con 0x7fb2541f59c0 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb25a800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb254162140 con 0x7fb254141270 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb25a800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb2540b7950 con 0x7fb23c004d40 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 0x7fb2541f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 0x7fb2541f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50988/0 (socket says 172.21.15.2:50988) 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 -- 172.21.15.2:0/246334001 learned_addr learned my addr 172.21.15.2:0/246334001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb258a00640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb254141270 0x7fb254141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259400640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb23c004d40 0x7fb254144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 -- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb23c004d40 msgr2=0x7fb254144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb23c004d40 0x7fb254144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 -- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb254141270 msgr2=0x7fb254141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb254141270 0x7fb254141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.799+0000 7fb259e00640 1 -- 172.21.15.2:0/246334001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb254141bc0 con 0x7fb2541f59c0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.800+0000 7fb259e00640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 0x7fb2541f5dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00e230 tx=0x7fb24c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.800+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c034040 con 0x7fb2541f59c0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.800+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c003990 con 0x7fb2541f59c0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.800+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c009c10 con 0x7fb2541f59c0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.800+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25413f1e0 con 0x7fb2541f59c0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.800+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25413f480 con 0x7fb2541f59c0 2024-05-14T15:16:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.802+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb254050870 con 0x7fb2541f59c0 2024-05-14T15:16:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.803+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb24c037020 con 0x7fb2541f59c0 2024-05-14T15:16:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.804+0000 7fb251600640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2340762d0 0x7fb2340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.804+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fb24c0b83b0 con 0x7fb2541f59c0 2024-05-14T15:16:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.804+0000 7fb259400640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2340762d0 0x7fb2340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.806+0000 7fb259400640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2340762d0 0x7fb2340787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb248000fb0 tx=0x7fb248009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:48.809+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb254141bc0 con 0x7fb2541f59c0 2024-05-14T15:16:49.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.034+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2540b7d50 con 0x7fb2541f59c0 2024-05-14T15:16:49.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.034+0000 7fb251600640 1 -- 172.21.15.2:0/246334001 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fb24c081870 con 0x7fb2541f59c0 2024-05-14T15:16:49.034 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2340762d0 msgr2=0x7fb2340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2340762d0 0x7fb2340787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb248000fb0 tx=0x7fb248009040 comp rx=0 tx=0).stop 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 msgr2=0x7fb2541f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 0x7fb2541f5dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00e230 tx=0x7fb24c009750 comp rx=0 tx=0).stop 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 shutdown_connections 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb2340762d0 0x7fb2340787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb254141270 0x7fb254141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2541f59c0 0x7fb2541f5dd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 --2- 172.21.15.2:0/246334001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb23c004d40 0x7fb254144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 >> 172.21.15.2:0/246334001 conn(0x7fb254073d50 msgr2=0x7fb2540b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 shutdown_connections 2024-05-14T15:16:49.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.038+0000 7fb25a800640 1 -- 172.21.15.2:0/246334001 wait complete. 2024-05-14T15:16:49.068 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-05-14T15:16:49.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:49.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-14T15:16:49.480 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:49.480 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:16:49.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:49.480 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-14T15:16:49.541 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:16:49.541 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:49.603 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:16:49.603 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:49.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.964+0000 7f290e800640 1 Processor -- start 2024-05-14T15:16:49.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.964+0000 7f290e800640 1 -- start start 2024-05-14T15:16:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290e800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f29080b0b90 0x7f290806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290e800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29080aed30 con 0x7f2908165ce0 2024-05-14T15:16:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290e800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290806f290 con 0x7f29080ae750 2024-05-14T15:16:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290e800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f290806f8e0 con 0x7f29080b0b90 2024-05-14T15:16:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290ca00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2908165ce0 0x7f29080b0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33418/0 (socket says 172.21.15.2:33418) 2024-05-14T15:16:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290ca00640 1 -- 172.21.15.2:0/3949834231 learned_addr learned my addr 172.21.15.2:0/3949834231 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.967+0000 7f290de00640 1 --2- 172.21.15.2:0/3949834231 >> v2:172.21.15.156:3300/0 conn(0x7f29080b0b90 0x7f290806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342463871 0 0) 0x7f29080aed30 con 0x7f2908165ce0 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28f0003520 con 0x7f2908165ce0 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 147250396 0 0) 0x7f28f0003520 con 0x7f2908165ce0 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 >> v2:172.21.15.156:3300/0 conn(0x7f29080b0b90 msgr2=0x7f290806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 --2- 172.21.15.2:0/3949834231 >> v2:172.21.15.156:3300/0 conn(0x7f29080b0b90 0x7f290806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 >> v1:172.21.15.156:6789/0 conn(0x7f29080ae750 legacy=0x7f2908165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290806f570 con 0x7f2908165ce0 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f28f8001a70 con 0x7f2908165ce0 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 >> v1:172.21.15.2:6789/0 conn(0x7f2908165ce0 legacy=0x7f29080b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0003a50 0x7f28f0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f0004800 0x7f28f0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f0005250 0x7f28f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f290806f8e0 con 0x7f28f0005250 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f28f000c1e0 con 0x7f28f0004800 2024-05-14T15:16:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.968+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f28f000c3e0 con 0x7f28f0003a50 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290de00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f0005250 0x7f28f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290ca00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f0004800 0x7f28f0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290d400640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0003a50 0x7f28f0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290de00640 1 -- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0003a50 msgr2=0x7f28f0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290de00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0003a50 0x7f28f0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290de00640 1 -- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f0004800 msgr2=0x7f28f0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290de00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f0004800 0x7f28f0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.969+0000 7f290de00640 1 -- 172.21.15.2:0/3949834231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f0003520 con 0x7f28f0005250 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.970+0000 7f290de00640 1 -- 172.21.15.2:0/3949834231 reap_dead start 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.970+0000 7f290de00640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f0005250 0x7f28f000b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2900009a90 tx=0x7f28f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fbd9e4195016f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.970+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900036070 con 0x7f28f0005250 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900031400 con 0x7f28f0005250 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f2907e00640 1 -- 172.21.15.2:0/3949834231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900009690 con 0x7f28f0005250 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 -- 172.21.15.2:0/3949834231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f0005250 msgr2=0x7f28f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f0005250 0x7f28f000b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2900009a90 tx=0x7f28f0005830 comp rx=0 tx=0).stop 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 -- 172.21.15.2:0/3949834231 shutdown_connections 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 --2- 172.21.15.2:0/3949834231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28f0005250 0x7f28f000b9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 -- 172.21.15.2:0/3949834231 >> 172.21.15.2:0/3949834231 conn(0x7f29080739a0 msgr2=0x7f2908073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 -- 172.21.15.2:0/3949834231 shutdown_connections 2024-05-14T15:16:49.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.971+0000 7f290e800640 1 -- 172.21.15.2:0/3949834231 wait complete. 2024-05-14T15:16:49.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.974+0000 7f290e800640 1 Processor -- start 2024-05-14T15:16:49.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.974+0000 7f290e800640 1 -- start start 2024-05-14T15:16:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290e800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0005250 0x7f2908149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29081ee630 0x7f290809c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 0x7f290809ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290e800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2908167b10 con 0x7f29081eea40 2024-05-14T15:16:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290e800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2908167990 con 0x7f29081ee630 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290e800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f2908165240 con 0x7f28f0005250 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 0x7f290809ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 0x7f290809ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45372/0 (socket says 172.21.15.2:45372) 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 -- 172.21.15.2:0/998387342 learned_addr learned my addr 172.21.15.2:0/998387342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290ca00640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29081ee630 0x7f290809c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290d400640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0005250 0x7f2908149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 -- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0005250 msgr2=0x7f2908149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0005250 0x7f2908149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 -- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29081ee630 msgr2=0x7f290809c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29081ee630 0x7f290809c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290de00640 1 -- 172.21.15.2:0/998387342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29081ef210 con 0x7f29081eea40 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.976+0000 7f290ca00640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29081ee630 0x7f290809c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.977+0000 7f290de00640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 0x7f290809ce90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f290002abb0 tx=0x7f2900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:49.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.977+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900043070 con 0x7f29081eea40 2024-05-14T15:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.977+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290003c470 con 0x7f29081eea40 2024-05-14T15:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.977+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900036040 con 0x7f29081eea40 2024-05-14T15:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.977+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29081ef4f0 con 0x7f29081eea40 2024-05-14T15:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.977+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29081faf20 con 0x7f29081eea40 2024-05-14T15:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.979+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29080769e0 con 0x7f29081eea40 2024-05-14T15:16:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.980+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2900046070 con 0x7f29081eea40 2024-05-14T15:16:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.981+0000 7f2905600640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f28ec0762d0 0x7f28ec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:49.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.981+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f29000b7670 con 0x7f29081eea40 2024-05-14T15:16:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.982+0000 7f290d400640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f28ec0762d0 0x7f28ec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.983+0000 7f290d400640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f28ec0762d0 0x7f28ec0787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28fc007fd0 tx=0x7f28fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:49.986+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f29080769e0 con 0x7f29081eea40 2024-05-14T15:16:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.212+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f29080d0d60 con 0x7f29081eea40 2024-05-14T15:16:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.213+0000 7f2905600640 1 -- 172.21.15.2:0/998387342 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f29000804e0 con 0x7f29081eea40 2024-05-14T15:16:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.216+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f28ec0762d0 msgr2=0x7f28ec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.216+0000 7f290e800640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f28ec0762d0 0x7f28ec0787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28fc007fd0 tx=0x7f28fc009040 comp rx=0 tx=0).stop 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.216+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 msgr2=0x7f290809ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.216+0000 7f290e800640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 0x7f290809ce90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f290002abb0 tx=0x7f2900004730 comp rx=0 tx=0).stop 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 shutdown_connections 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f28ec0762d0 0x7f28ec0787e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29081ee630 0x7f290809c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29081eea40 0x7f290809ce90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 --2- 172.21.15.2:0/998387342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28f0005250 0x7f2908149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 >> 172.21.15.2:0/998387342 conn(0x7f29080739a0 msgr2=0x7f290814cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 shutdown_connections 2024-05-14T15:16:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.217+0000 7f290e800640 1 -- 172.21.15.2:0/998387342 wait complete. 2024-05-14T15:16:50.247 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:16:50.247 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:16:50.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T15:16:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.600+0000 7f8ed5a00640 1 Processor -- start 2024-05-14T15:16:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.600+0000 7f8ed5a00640 1 -- start start 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed0161f10 0x7f8ed00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ed00cfc70 0x7f8ed00d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed00b0360 con 0x7f8ed00af630 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f8ed00b0f70 con 0x7f8ed00cfc70 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed00b0640 con 0x7f8ed0161f10 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ed00cfc70 0x7f8ed00d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ecfe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8ed00af630 0x7f8ed0161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33422/0 (socket says 172.21.15.2:33422) 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ed5000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ed00cfc70 0x7f8ed00d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45388/0 (socket says 172.21.15.2:45388) 2024-05-14T15:16:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.603+0000 7f8ecfe00640 1 -- 172.21.15.2:0/3630460283 learned_addr learned my addr 172.21.15.2:0/3630460283 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.604+0000 7f8ecf400640 1 --2- 172.21.15.2:0/3630460283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed0161f10 0x7f8ed00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.604+0000 7f8ed5000640 1 -- 172.21.15.2:0/3630460283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed0161f10 msgr2=0x7f8ed00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.604+0000 7f8ed5000640 1 --2- 172.21.15.2:0/3630460283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed0161f10 0x7f8ed00cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.604+0000 7f8ed5000640 1 -- 172.21.15.2:0/3630460283 >> v1:172.21.15.2:6789/0 conn(0x7f8ed00af630 legacy=0x7f8ed0161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.604+0000 7f8ed5000640 1 -- 172.21.15.2:0/3630460283 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed00b0920 con 0x7f8ed00cfc70 2024-05-14T15:16:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.605+0000 7f8ed5000640 1 --2- 172.21.15.2:0/3630460283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00cfc70 0x7f8ed00d0080 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009d90 tx=0x7f8ec802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723b941b82049fde server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.605+0000 7f8ecea00640 1 -- 172.21.15.2:0/3630460283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8007740 con 0x7f8ed00cfc70 2024-05-14T15:16:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.605+0000 7f8ecea00640 1 -- 172.21.15.2:0/3630460283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec80078e0 con 0x7f8ed00cfc70 2024-05-14T15:16:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.605+0000 7f8ecea00640 1 -- 172.21.15.2:0/3630460283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8007cb0 con 0x7f8ed00cfc70 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 -- 172.21.15.2:0/3630460283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00cfc70 msgr2=0x7f8ed00d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/3630460283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00cfc70 0x7f8ed00d0080 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009d90 tx=0x7f8ec802a660 comp rx=0 tx=0).stop 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 -- 172.21.15.2:0/3630460283 shutdown_connections 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/3630460283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00cfc70 0x7f8ed00d0080 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/3630460283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed0161f10 0x7f8ed00cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 -- 172.21.15.2:0/3630460283 >> 172.21.15.2:0/3630460283 conn(0x7f8ed00739a0 msgr2=0x7f8ed0073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 -- 172.21.15.2:0/3630460283 shutdown_connections 2024-05-14T15:16:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.606+0000 7f8ed5a00640 1 -- 172.21.15.2:0/3630460283 wait complete. 2024-05-14T15:16:50.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.609+0000 7f8ed5a00640 1 Processor -- start 2024-05-14T15:16:50.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.609+0000 7f8ed5a00640 1 -- start start 2024-05-14T15:16:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.610+0000 7f8ed5a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 0x7f8ed014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.610+0000 7f8ed5a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed00cfc70 0x7f8ed0155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.610+0000 7f8ed5a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ed01555c0 0x7f8ed01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.610+0000 7f8ed5a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed00afa40 con 0x7f8ed00af630 2024-05-14T15:16:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.610+0000 7f8ed5a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0162560 con 0x7f8ed01555c0 2024-05-14T15:16:50.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.610+0000 7f8ed5a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed00afbc0 con 0x7f8ed00cfc70 2024-05-14T15:16:50.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 0x7f8ed014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 0x7f8ed014fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45390/0 (socket says 172.21.15.2:45390) 2024-05-14T15:16:50.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 -- 172.21.15.2:0/2735919951 learned_addr learned my addr 172.21.15.2:0/2735919951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 -- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed00cfc70 msgr2=0x7f8ed0155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed00cfc70 0x7f8ed0155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 -- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ed01555c0 msgr2=0x7f8ed01559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ed01555c0 0x7f8ed01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 -- 172.21.15.2:0/2735919951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed0150870 con 0x7f8ed00af630 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.611+0000 7f8ecfe00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 0x7f8ed014fd00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0001eb0 tx=0x7f8ec000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.612+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0017070 con 0x7f8ed00af630 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.612+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0005d00 con 0x7f8ed00af630 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.612+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed0150b50 con 0x7f8ed00af630 2024-05-14T15:16:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.612+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0007310 con 0x7f8ed00af630 2024-05-14T15:16:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.612+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed0151110 con 0x7f8ed00af630 2024-05-14T15:16:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.613+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed0161360 con 0x7f8ed00af630 2024-05-14T15:16:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.614+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ec001a070 con 0x7f8ed00af630 2024-05-14T15:16:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.615+0000 7f8ec7e00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8eb0076300 0x7f8eb0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.616+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f8ec0096cb0 con 0x7f8ed00af630 2024-05-14T15:16:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.616+0000 7f8ecf400640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8eb0076300 0x7f8eb0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.618+0000 7f8ecf400640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8eb0076300 0x7f8eb0078810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006fd0 tx=0x7f8ebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.620+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ed0161360 con 0x7f8ed00af630 2024-05-14T15:16:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.841+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ed0050870 con 0x7f8ed00af630 2024-05-14T15:16:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.842+0000 7f8ec7e00640 1 -- 172.21.15.2:0/2735919951 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f8ec0060290 con 0x7f8ed00af630 2024-05-14T15:16:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.844+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8eb0076300 msgr2=0x7f8eb0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.844+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8eb0076300 0x7f8eb0078810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006fd0 tx=0x7f8ebc008040 comp rx=0 tx=0).stop 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 msgr2=0x7f8ed014fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 0x7f8ed014fd00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0001eb0 tx=0x7f8ec000c890 comp rx=0 tx=0).stop 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 shutdown_connections 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f8eb0076300 0x7f8eb0078810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ed01555c0 0x7f8ed01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ed00cfc70 0x7f8ed0155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 --2- 172.21.15.2:0/2735919951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ed00af630 0x7f8ed014fd00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 >> 172.21.15.2:0/2735919951 conn(0x7f8ed00739a0 msgr2=0x7f8ed0153280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 shutdown_connections 2024-05-14T15:16:50.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:50.845+0000 7f8ed5a00640 1 -- 172.21.15.2:0/2735919951 wait complete. 2024-05-14T15:16:50.872 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi156.front.sepia.ceph.com... 2024-05-14T15:16:50.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:50.872 DEBUG:teuthology.orchestra.run.smithi156:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-14T15:16:50.962 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:50.962 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:16:50.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:50.963 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-14T15:16:51.015 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-14T15:16:51.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.306+0000 7fdb75200640 1 Processor -- start 2024-05-14T15:16:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.306+0000 7fdb75200640 1 -- start start 2024-05-14T15:16:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.309+0000 7fdb75200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 0x7fdb700d4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.309+0000 7fdb75200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb701646c0 con 0x7fdb7006dc80 2024-05-14T15:16:51.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.309+0000 7fdb75200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb701649a0 con 0x7fdb700d0160 2024-05-14T15:16:51.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.309+0000 7fdb75200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fdb70164480 con 0x7fdb70164070 2024-05-14T15:16:51.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.309+0000 7fdb6e800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdb7006dc80 0x7fdb70160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33434/0 (socket says 172.21.15.2:33434) 2024-05-14T15:16:51.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.309+0000 7fdb6e800640 1 -- 172.21.15.2:0/1848970263 learned_addr learned my addr 172.21.15.2:0/1848970263 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6de00640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 0x7fdb700d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663114719 0 0) 0x7fdb701646c0 con 0x7fdb7006dc80 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb54003520 con 0x7fdb7006dc80 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2265395526 0 0) 0x7fdb54003520 con 0x7fdb7006dc80 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 msgr2=0x7fdb700d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 0x7fdb700d4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 >> v1:172.21.15.156:6789/0 conn(0x7fdb700d0160 legacy=0x7fdb700d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb70164c80 con 0x7fdb7006dc80 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fdb68001a70 con 0x7fdb7006dc80 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 >> v1:172.21.15.2:6789/0 conn(0x7fdb7006dc80 legacy=0x7fdb70160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb54003a30 0x7fdb54003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 0x7fdb54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54004d40 0x7fdb540051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70164480 con 0x7fdb54004d40 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5400bb80 con 0x7fdb54003a30 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.310+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5400bd80 con 0x7fdb70164070 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6e800640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54004d40 0x7fdb540051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6de00640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb54003a30 0x7fdb54003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb65400640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 0x7fdb54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6e800640 1 -- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 msgr2=0x7fdb54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6e800640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb70164070 0x7fdb54004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6e800640 1 -- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb54003a30 msgr2=0x7fdb54003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6e800640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb54003a30 0x7fdb54003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.311+0000 7fdb6e800640 1 -- 172.21.15.2:0/1848970263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb54003520 con 0x7fdb54004d40 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.312+0000 7fdb6e800640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54004d40 0x7fdb540051f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800a880 tx=0x7fdb54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7694f0ae7e389fd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.312+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800a4d0 con 0x7fdb54004d40 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6802f070 con 0x7fdb54004d40 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb6d400640 1 -- 172.21.15.2:0/1848970263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6802bbf0 con 0x7fdb54004d40 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb75200640 1 -- 172.21.15.2:0/1848970263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54004d40 msgr2=0x7fdb540051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb75200640 1 --2- 172.21.15.2:0/1848970263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb54004d40 0x7fdb540051f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800a880 tx=0x7fdb54005830 comp rx=0 tx=0).stop 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb6e800640 1 -- 172.21.15.2:0/1848970263 reap_dead start 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb75200640 1 -- 172.21.15.2:0/1848970263 shutdown_connections 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb75200640 1 -- 172.21.15.2:0/1848970263 >> 172.21.15.2:0/1848970263 conn(0x7fdb700d2770 msgr2=0x7fdb700d2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb75200640 1 -- 172.21.15.2:0/1848970263 shutdown_connections 2024-05-14T15:16:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.313+0000 7fdb75200640 1 -- 172.21.15.2:0/1848970263 wait complete. 2024-05-14T15:16:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.316+0000 7fdb75200640 1 Processor -- start 2024-05-14T15:16:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.316+0000 7fdb75200640 1 -- start start 2024-05-14T15:16:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb75200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb54004d40 0x7fdb701414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb75200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb70151fb0 0x7fdb70153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb75200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 0x7fdb701625b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb75200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700d4af0 con 0x7fdb700c8d00 2024-05-14T15:16:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb75200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700d4970 con 0x7fdb70151fb0 2024-05-14T15:16:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb75200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700d4c70 con 0x7fdb54004d40 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 0x7fdb701625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 0x7fdb701625b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45408/0 (socket says 172.21.15.2:45408) 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 -- 172.21.15.2:0/2081063042 learned_addr learned my addr 172.21.15.2:0/2081063042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb65400640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb70151fb0 0x7fdb70153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6de00640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb54004d40 0x7fdb701414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 -- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb54004d40 msgr2=0x7fdb701414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb54004d40 0x7fdb701414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 -- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb70151fb0 msgr2=0x7fdb70153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb70151fb0 0x7fdb70153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb6e800640 1 -- 172.21.15.2:0/2081063042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb70153bd0 con 0x7fdb700c8d00 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.318+0000 7fdb65400640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb70151fb0 0x7fdb70153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.319+0000 7fdb6e800640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 0x7fdb701625b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb6802b4a0 tx=0x7fdb70164b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.319+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800a4d0 con 0x7fdb700c8d00 2024-05-14T15:16:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.319+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb68034470 con 0x7fdb700c8d00 2024-05-14T15:16:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.319+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701527a0 con 0x7fdb700c8d00 2024-05-14T15:16:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.319+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68002020 con 0x7fdb700c8d00 2024-05-14T15:16:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.319+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb70152d60 con 0x7fdb700c8d00 2024-05-14T15:16:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.320+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70153da0 con 0x7fdb700c8d00 2024-05-14T15:16:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.322+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb68034840 con 0x7fdb700c8d00 2024-05-14T15:16:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.324+0000 7fdb66a00640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fdb4c0762d0 0x7fdb4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.324+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fdb680b79f0 con 0x7fdb700c8d00 2024-05-14T15:16:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.324+0000 7fdb6de00640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fdb4c0762d0 0x7fdb4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.326+0000 7fdb6de00640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fdb4c0762d0 0x7fdb4c0787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb7008e510 tx=0x7fdb60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.329+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdb68080f40 con 0x7fdb700c8d00 2024-05-14T15:16:51.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.584+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb70050870 con 0x7fdb700c8d00 2024-05-14T15:16:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.585+0000 7fdb66a00640 1 -- 172.21.15.2:0/2081063042 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7fdb68080840 con 0x7fdb700c8d00 2024-05-14T15:16:51.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:51.585 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fdb4c0762d0 msgr2=0x7fdb4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fdb4c0762d0 0x7fdb4c0787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb7008e510 tx=0x7fdb60008040 comp rx=0 tx=0).stop 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 msgr2=0x7fdb701625b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 0x7fdb701625b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb6802b4a0 tx=0x7fdb70164b70 comp rx=0 tx=0).stop 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 shutdown_connections 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fdb4c0762d0 0x7fdb4c0787e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb70151fb0 0x7fdb70153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb700c8d00 0x7fdb701625b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 --2- 172.21.15.2:0/2081063042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb54004d40 0x7fdb701414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.588+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 >> 172.21.15.2:0/2081063042 conn(0x7fdb700d2770 msgr2=0x7fdb7006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:51.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.589+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 shutdown_connections 2024-05-14T15:16:51.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.589+0000 7fdb75200640 1 -- 172.21.15.2:0/2081063042 wait complete. 2024-05-14T15:16:51.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:51.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.888+0000 7f62bfe00640 1 Processor -- start 2024-05-14T15:16:51.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.888+0000 7f62bfe00640 1 -- start start 2024-05-14T15:16:51.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.889+0000 7f62bfe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f62c00b4dc0 0x7f62c00d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f62c0163bb0 0x7f62c00d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c00d4310 0x7f62c0160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bfe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f62c00d48d0 con 0x7f62c0163bb0 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bfe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f62c00d4bb0 con 0x7f62c00b4dc0 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bfe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f62c00d4e90 con 0x7f62c00d4310 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f62c0163bb0 0x7f62c00d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f62c0163bb0 0x7f62c00d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45418/0 (socket says 172.21.15.2:45418) 2024-05-14T15:16:51.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 -- 172.21.15.2:0/3507254867 learned_addr learned my addr 172.21.15.2:0/3507254867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bf400640 1 --2- 172.21.15.2:0/3507254867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c00d4310 0x7f62c0160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62bea00640 1 --2- 172.21.15.2:0/3507254867 >> v2:172.21.15.156:3300/0 conn(0x7f62c00b4dc0 0x7f62c00d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 -- 172.21.15.2:0/3507254867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c00d4310 msgr2=0x7f62c0160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 --2- 172.21.15.2:0/3507254867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c00d4310 0x7f62c0160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 -- 172.21.15.2:0/3507254867 >> v2:172.21.15.156:3300/0 conn(0x7f62c00b4dc0 msgr2=0x7f62c00d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.890+0000 7f62be000640 1 --2- 172.21.15.2:0/3507254867 >> v2:172.21.15.156:3300/0 conn(0x7f62c00b4dc0 0x7f62c00d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.891+0000 7f62be000640 1 -- 172.21.15.2:0/3507254867 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c00d5170 con 0x7f62c0163bb0 2024-05-14T15:16:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.892+0000 7f62be000640 1 --2- 172.21.15.2:0/3507254867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c0163bb0 0x7f62c00d0cb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62c008e960 tx=0x7f62b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44341bc86173c15 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.892+0000 7f62bd600640 1 -- 172.21.15.2:0/3507254867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0036070 con 0x7f62c0163bb0 2024-05-14T15:16:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.892+0000 7f62bd600640 1 -- 172.21.15.2:0/3507254867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0031600 con 0x7f62c0163bb0 2024-05-14T15:16:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.892+0000 7f62bd600640 1 -- 172.21.15.2:0/3507254867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00319d0 con 0x7f62c0163bb0 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 -- 172.21.15.2:0/3507254867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c0163bb0 msgr2=0x7f62c00d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3507254867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c0163bb0 0x7f62c00d0cb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62c008e960 tx=0x7f62b002a6a0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 -- 172.21.15.2:0/3507254867 shutdown_connections 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3507254867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c00d4310 0x7f62c0160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3507254867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c0163bb0 0x7f62c00d0cb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3507254867 >> v2:172.21.15.156:3300/0 conn(0x7f62c00b4dc0 0x7f62c00d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 -- 172.21.15.2:0/3507254867 >> 172.21.15.2:0/3507254867 conn(0x7f62c00b7600 msgr2=0x7f62c00b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 -- 172.21.15.2:0/3507254867 shutdown_connections 2024-05-14T15:16:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.893+0000 7f62bfe00640 1 -- 172.21.15.2:0/3507254867 wait complete. 2024-05-14T15:16:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.895+0000 7f62bfe00640 1 Processor -- start 2024-05-14T15:16:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.895+0000 7f62bfe00640 1 -- start start 2024-05-14T15:16:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c00b4dc0 0x7f62c015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 0x7f62c00c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c0163bb0 0x7f62c015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62bfe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f62c0160cc0 con 0x7f62c00d4310 2024-05-14T15:16:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62bfe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f62c0160b40 con 0x7f62c00b4dc0 2024-05-14T15:16:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62bfe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f62c0160e40 con 0x7f62c0163bb0 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62be000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 0x7f62c00c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62be000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 0x7f62c00c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45420/0 (socket says 172.21.15.2:45420) 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.897+0000 7f62be000640 1 -- 172.21.15.2:0/3816533977 learned_addr learned my addr 172.21.15.2:0/3816533977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62bea00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c00b4dc0 0x7f62c015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62bf400640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c0163bb0 0x7f62c015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62be000640 1 -- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c0163bb0 msgr2=0x7f62c015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62be000640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c0163bb0 0x7f62c015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62be000640 1 -- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c00b4dc0 msgr2=0x7f62c015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62be000640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c00b4dc0 0x7f62c015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62be000640 1 -- 172.21.15.2:0/3816533977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c015c5a0 con 0x7f62c00d4310 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62bea00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c00b4dc0 0x7f62c015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62bf400640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c0163bb0 0x7f62c015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62be000640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 0x7f62c00c9460 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62b0034040 tx=0x7f62b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.898+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0041020 con 0x7f62c00d4310 2024-05-14T15:16:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.899+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0007820 con 0x7f62c00d4310 2024-05-14T15:16:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.899+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0036040 con 0x7f62c00d4310 2024-05-14T15:16:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.899+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c015c880 con 0x7f62c00d4310 2024-05-14T15:16:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.899+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c015d8a0 con 0x7f62c00d4310 2024-05-14T15:16:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.900+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c014d160 con 0x7f62c00d4310 2024-05-14T15:16:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.901+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f62b0044020 con 0x7f62c00d4310 2024-05-14T15:16:51.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.903+0000 7f62b6a00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f629c0762d0 0x7f629c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:51.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.903+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f62b00b87b0 con 0x7f62c00d4310 2024-05-14T15:16:51.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.903+0000 7f62bea00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f629c0762d0 0x7f629c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:51.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.904+0000 7f62bea00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f629c0762d0 0x7f629c0787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62a800b800 tx=0x7f62a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:51.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:51.907+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f62b004b030 con 0x7f62c00d4310 2024-05-14T15:16:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.157+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62c0068e00 con 0x7f62c00d4310 2024-05-14T15:16:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.158+0000 7f62b6a00640 1 -- 172.21.15.2:0/3816533977 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7f62c0068e00 con 0x7f62c00d4310 2024-05-14T15:16:52.158 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:52.162 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f629c0762d0 msgr2=0x7f629c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f629c0762d0 0x7f629c0787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62a800b800 tx=0x7f62a8008040 comp rx=0 tx=0).stop 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 msgr2=0x7f62c00c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 0x7f62c00c9460 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62b0034040 tx=0x7f62b0004a40 comp rx=0 tx=0).stop 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 shutdown_connections 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f629c0762d0 0x7f629c0787e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c0163bb0 0x7f62c015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c00d4310 0x7f62c00c9460 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 --2- 172.21.15.2:0/3816533977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c00b4dc0 0x7f62c015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 >> 172.21.15.2:0/3816533977 conn(0x7f62c00b7600 msgr2=0x7f62c00d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 shutdown_connections 2024-05-14T15:16:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.161+0000 7f62bfe00640 1 -- 172.21.15.2:0/3816533977 wait complete. 2024-05-14T15:16:52.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.454+0000 7f93ffe00640 1 Processor -- start 2024-05-14T15:16:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.454+0000 7f93ffe00640 1 -- start start 2024-05-14T15:16:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.456+0000 7f93ffe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f940006d700 0x7f940006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93ffe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000ae750 0x7f94000aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93ffe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940006e050 con 0x7f94000d1050 2024-05-14T15:16:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93ffe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f94001624e0 con 0x7f940006d700 2024-05-14T15:16:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93ffe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f94001618d0 con 0x7f94000ae750 2024-05-14T15:16:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f940006d700 0x7f940006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f940006d700 0x7f940006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45422/0 (socket says 172.21.15.2:45422) 2024-05-14T15:16:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 -- 172.21.15.2:0/1220665707 learned_addr learned my addr 172.21.15.2:0/1220665707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 -- 172.21.15.2:0/1220665707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000ae750 msgr2=0x7f94000aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 --2- 172.21.15.2:0/1220665707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000ae750 0x7f94000aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 -- 172.21.15.2:0/1220665707 >> v1:172.21.15.2:6789/0 conn(0x7f94000d1050 legacy=0x7f9400070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.457+0000 7f93f7e00640 1 -- 172.21.15.2:0/1220665707 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9400161bb0 con 0x7f940006d700 2024-05-14T15:16:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.458+0000 7f93f7e00640 1 --2- 172.21.15.2:0/1220665707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f940006d700 0x7f940006db10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009870 tx=0x7f93e802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ccef6459c01109 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.459+0000 7f93fe000640 1 -- 172.21.15.2:0/1220665707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8037070 con 0x7f940006d700 2024-05-14T15:16:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.459+0000 7f93fe000640 1 -- 172.21.15.2:0/1220665707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e8032440 con 0x7f940006d700 2024-05-14T15:16:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.459+0000 7f93fe000640 1 -- 172.21.15.2:0/1220665707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8032810 con 0x7f940006d700 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 -- 172.21.15.2:0/1220665707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f940006d700 msgr2=0x7f940006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 --2- 172.21.15.2:0/1220665707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f940006d700 0x7f940006db10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009870 tx=0x7f93e802a250 comp rx=0 tx=0).stop 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 -- 172.21.15.2:0/1220665707 shutdown_connections 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 --2- 172.21.15.2:0/1220665707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000ae750 0x7f94000aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 --2- 172.21.15.2:0/1220665707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f940006d700 0x7f940006db10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 -- 172.21.15.2:0/1220665707 >> 172.21.15.2:0/1220665707 conn(0x7f94000732e0 msgr2=0x7f94000736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 -- 172.21.15.2:0/1220665707 shutdown_connections 2024-05-14T15:16:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.460+0000 7f93ffe00640 1 -- 172.21.15.2:0/1220665707 wait complete. 2024-05-14T15:16:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.462+0000 7f93ffe00640 1 Processor -- start 2024-05-14T15:16:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.463+0000 7f93ffe00640 1 -- start start 2024-05-14T15:16:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.464+0000 7f93ffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f940006d700 0x7f940014c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.464+0000 7f93ffe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 0x7f94001e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.464+0000 7f93ffe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000d1050 0x7f94001605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.464+0000 7f93ffe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9400071050 con 0x7f94000ae750 2024-05-14T15:16:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.464+0000 7f93ffe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9400162170 con 0x7f940006d700 2024-05-14T15:16:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.464+0000 7f93ffe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f940015f110 con 0x7f94000d1050 2024-05-14T15:16:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 0x7f94001e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 0x7f94001e9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45430/0 (socket says 172.21.15.2:45430) 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 -- 172.21.15.2:0/2565147794 learned_addr learned my addr 172.21.15.2:0/2565147794 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93fea00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f940006d700 0x7f940014c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 -- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000d1050 msgr2=0x7f94001605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000d1050 0x7f94001605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 -- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f940006d700 msgr2=0x7f940014c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f940006d700 0x7f940014c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 -- 172.21.15.2:0/2565147794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94001ead50 con 0x7f94000ae750 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.465+0000 7f93f7e00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 0x7f94001e9d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f93e8000c00 tx=0x7f93e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.466+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8041070 con 0x7f94000ae750 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.466+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e803c870 con 0x7f94000ae750 2024-05-14T15:16:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.466+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8037040 con 0x7f94000ae750 2024-05-14T15:16:52.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.466+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94001f7870 con 0x7f94000ae750 2024-05-14T15:16:52.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.466+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94000cf100 con 0x7f94000ae750 2024-05-14T15:16:52.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.467+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94001ea7e0 con 0x7f94000ae750 2024-05-14T15:16:52.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.468+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93e8044070 con 0x7f94000ae750 2024-05-14T15:16:52.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.469+0000 7f93f6a00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93dc076300 0x7f93dc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.469+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f93e80b84f0 con 0x7f94000ae750 2024-05-14T15:16:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.470+0000 7f93fea00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93dc076300 0x7f93dc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.471+0000 7f93fea00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93dc076300 0x7f93dc078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9400074f20 tx=0x7f93f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:52.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.474+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f94001ead50 con 0x7f94000ae750 2024-05-14T15:16:52.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.695+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9400050870 con 0x7f94000ae750 2024-05-14T15:16:52.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.698+0000 7f93f6a00640 1 -- 172.21.15.2:0/2565147794 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18541 (secure 0 0 0) 0x7f93e8081a40 con 0x7f94000ae750 2024-05-14T15:16:52.698 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:52.699 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:16:29.950718+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93dc076300 msgr2=0x7f93dc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93dc076300 0x7f93dc078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9400074f20 tx=0x7f93f0009040 comp rx=0 tx=0).stop 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 msgr2=0x7f94001e9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 0x7f94001e9d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f93e8000c00 tx=0x7f93e80046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 shutdown_connections 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93dc076300 0x7f93dc078810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94000d1050 0x7f94001605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94000ae750 0x7f94001e9d00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 --2- 172.21.15.2:0/2565147794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f940006d700 0x7f940014c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:52.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 >> 172.21.15.2:0/2565147794 conn(0x7f94000732e0 msgr2=0x7f9400068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:52.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.701+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 shutdown_connections 2024-05-14T15:16:52.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:52.702+0000 7f93ffe00640 1 -- 172.21.15.2:0/2565147794 wait complete. 2024-05-14T15:16:52.730 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T15:16:52.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:53.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.011+0000 7faebf200640 1 Processor -- start 2024-05-14T15:16:53.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.011+0000 7faebf200640 1 -- start start 2024-05-14T15:16:53.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebf200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faec006e360 0x7faec00d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec00d2690 con 0x7faec006d4c0 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebf200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7faec0160140 con 0x7faec006e360 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7faec0160420 con 0x7faec00d2280 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faec006e360 0x7faec00d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebe800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faec006d4c0 0x7faec015df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33448/0 (socket says 172.21.15.2:33448) 2024-05-14T15:16:53.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.014+0000 7faebe800640 1 -- 172.21.15.2:0/2643831470 learned_addr learned my addr 172.21.15.2:0/2643831470 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.015+0000 7faebd400640 1 --2- 172.21.15.2:0/2643831470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.015+0000 7faebde00640 1 -- 172.21.15.2:0/2643831470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 msgr2=0x7faec006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.015+0000 7faebde00640 1 --2- 172.21.15.2:0/2643831470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec006cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.015+0000 7faebde00640 1 -- 172.21.15.2:0/2643831470 >> v1:172.21.15.2:6789/0 conn(0x7faec006d4c0 legacy=0x7faec015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.015+0000 7faebde00640 1 -- 172.21.15.2:0/2643831470 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0160700 con 0x7faec006e360 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.015+0000 7faebca00640 1 -- 172.21.15.2:0/2643831470 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844796422 0 0) 0x7faeb8001490 con 0x7faec006d4c0 2024-05-14T15:16:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.016+0000 7faebde00640 1 --2- 172.21.15.2:0/2643831470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00d1d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faeb00097a0 tx=0x7faeb002b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe213cae77d0939 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:53.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.016+0000 7faebca00640 1 -- 172.21.15.2:0/2643831470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0038070 con 0x7faec006e360 2024-05-14T15:16:53.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.016+0000 7faebca00640 1 -- 172.21.15.2:0/2643831470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb0033440 con 0x7faec006e360 2024-05-14T15:16:53.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.016+0000 7faebca00640 1 -- 172.21.15.2:0/2643831470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb00337f0 con 0x7faec006e360 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 -- 172.21.15.2:0/2643831470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 msgr2=0x7faec00d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 --2- 172.21.15.2:0/2643831470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00d1d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faeb00097a0 tx=0x7faeb002b290 comp rx=0 tx=0).stop 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 -- 172.21.15.2:0/2643831470 shutdown_connections 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 --2- 172.21.15.2:0/2643831470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec006cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 --2- 172.21.15.2:0/2643831470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00d1d40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 -- 172.21.15.2:0/2643831470 >> 172.21.15.2:0/2643831470 conn(0x7faec0073dc0 msgr2=0x7faec009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 -- 172.21.15.2:0/2643831470 shutdown_connections 2024-05-14T15:16:53.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.017+0000 7faebf200640 1 -- 172.21.15.2:0/2643831470 wait complete. 2024-05-14T15:16:53.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.020+0000 7faebf200640 1 Processor -- start 2024-05-14T15:16:53.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.020+0000 7faebf200640 1 -- start start 2024-05-14T15:16:53.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.021+0000 7faebf200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec006d4c0 0x7faec015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.021+0000 7faebf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.021+0000 7faebf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec0153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.021+0000 7faebf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faec0160fa0 con 0x7faec006e360 2024-05-14T15:16:53.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.021+0000 7faebf200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7faec0160cc0 con 0x7faec006d4c0 2024-05-14T15:16:53.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.021+0000 7faebf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7faec00b7340 con 0x7faec00d2280 2024-05-14T15:16:53.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45458/0 (socket says 172.21.15.2:45458) 2024-05-14T15:16:53.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 -- 172.21.15.2:0/2702932275 learned_addr learned my addr 172.21.15.2:0/2702932275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:53.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebde00640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec006d4c0 0x7faec015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebe800640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec0153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 -- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 msgr2=0x7faec0153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec0153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 -- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec006d4c0 msgr2=0x7faec015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec006d4c0 0x7faec015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebd400640 1 -- 172.21.15.2:0/2702932275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0152360 con 0x7faec006e360 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.022+0000 7faebde00640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec006d4c0 0x7faec015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.023+0000 7faebd400640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00ce520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faeac00d620 tx=0x7faeac00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.023+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac00b620 con 0x7faec006e360 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.023+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac019070 con 0x7faec006e360 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.023+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac00ba00 con 0x7faec006e360 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.023+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec0152640 con 0x7faec006e360 2024-05-14T15:16:53.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.023+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec0152c00 con 0x7faec006e360 2024-05-14T15:16:53.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.025+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec015b6e0 con 0x7faec006e360 2024-05-14T15:16:53.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.026+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faeac00bba0 con 0x7faec006e360 2024-05-14T15:16:53.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.027+0000 7faeb6000640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faea00762d0 0x7faea00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.027+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7faeac097e60 con 0x7faec006e360 2024-05-14T15:16:53.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.028+0000 7faebde00640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faea00762d0 0x7faea00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.029+0000 7faebde00640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faea00762d0 0x7faea00787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faeb0035000 tx=0x7faeb002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:53.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.032+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faeac0613b0 con 0x7faec006e360 2024-05-14T15:16:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.288+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faec0050870 con 0x7faec006e360 2024-05-14T15:16:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.289+0000 7faeb6000640 1 -- 172.21.15.2:0/2702932275 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7faeac060cb0 con 0x7faec006e360 2024-05-14T15:16:53.289 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:53.289 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faea00762d0 msgr2=0x7faea00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faea00762d0 0x7faea00787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faeb0035000 tx=0x7faeb002f000 comp rx=0 tx=0).stop 2024-05-14T15:16:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 msgr2=0x7faec00ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00ce520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faeac00d620 tx=0x7faeac00dae0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 shutdown_connections 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7faea00762d0 0x7faea00787e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec00d2280 0x7faec0153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec006e360 0x7faec00ce520 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 --2- 172.21.15.2:0/2702932275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec006d4c0 0x7faec015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.292+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 >> 172.21.15.2:0/2702932275 conn(0x7faec0073dc0 msgr2=0x7faec015e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.293+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 shutdown_connections 2024-05-14T15:16:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.293+0000 7faebf200640 1 -- 172.21.15.2:0/2702932275 wait complete. 2024-05-14T15:16:53.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:16:53.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.605+0000 7f7892c00640 1 Processor -- start 2024-05-14T15:16:53.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.605+0000 7f7892c00640 1 -- start start 2024-05-14T15:16:53.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.607+0000 7f7892c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c06d700 0x7f788c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.607+0000 7f7892c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f788c0ae750 0x7f788c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c06e050 con 0x7f788c0d1050 2024-05-14T15:16:53.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f788c1624e0 con 0x7f788c0ae750 2024-05-14T15:16:53.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f788c1618d0 con 0x7f788c06d700 2024-05-14T15:16:53.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f788c0ae750 0x7f788c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f788c0ae750 0x7f788c0aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45472/0 (socket says 172.21.15.2:45472) 2024-05-14T15:16:53.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 -- 172.21.15.2:0/2982382582 learned_addr learned my addr 172.21.15.2:0/2982382582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7890e00640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c06d700 0x7f788c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 -- 172.21.15.2:0/2982382582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c06d700 msgr2=0x7f788c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c06d700 0x7f788c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 -- 172.21.15.2:0/2982382582 >> v1:172.21.15.156:6789/0 conn(0x7f788c0d1050 legacy=0x7f788c070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7892200640 1 -- 172.21.15.2:0/2982382582 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c161bb0 con 0x7f788c0ae750 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.608+0000 7f7890e00640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c06d700 0x7f788c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:53.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.609+0000 7f7892200640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c0ae750 0x7f788c0aeb60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7884009e50 tx=0x7f788402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937c79555414360b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:53.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.610+0000 7f788be00640 1 -- 172.21.15.2:0/2982382582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884036070 con 0x7f788c0ae750 2024-05-14T15:16:53.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.610+0000 7f788be00640 1 -- 172.21.15.2:0/2982382582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884031600 con 0x7f788c0ae750 2024-05-14T15:16:53.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.610+0000 7f788be00640 1 -- 172.21.15.2:0/2982382582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840319d0 con 0x7f788c0ae750 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 -- 172.21.15.2:0/2982382582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c0ae750 msgr2=0x7f788c0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c0ae750 0x7f788c0aeb60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7884009e50 tx=0x7f788402a680 comp rx=0 tx=0).stop 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 -- 172.21.15.2:0/2982382582 shutdown_connections 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c0ae750 0x7f788c0aeb60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 --2- 172.21.15.2:0/2982382582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c06d700 0x7f788c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 -- 172.21.15.2:0/2982382582 >> 172.21.15.2:0/2982382582 conn(0x7f788c0732e0 msgr2=0x7f788c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 -- 172.21.15.2:0/2982382582 shutdown_connections 2024-05-14T15:16:53.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.611+0000 7f7892c00640 1 -- 172.21.15.2:0/2982382582 wait complete. 2024-05-14T15:16:53.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.614+0000 7f7892c00640 1 Processor -- start 2024-05-14T15:16:53.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.614+0000 7f7892c00640 1 -- start start 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7892c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 0x7f788c13e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7892c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c0ae750 0x7f788c1e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7892c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f788c0d1050 0x7f788c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7892c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f788c071050 con 0x7f788c06d700 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7892c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f788c162170 con 0x7f788c0d1050 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7892c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f788c15f110 con 0x7f788c0ae750 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7891800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 0x7f788c13e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7891800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 0x7f788c13e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45484/0 (socket says 172.21.15.2:45484) 2024-05-14T15:16:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.616+0000 7f7891800640 1 -- 172.21.15.2:0/3776444100 learned_addr learned my addr 172.21.15.2:0/3776444100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7890e00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c0ae750 0x7f788c1e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7892200640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f788c0d1050 0x7f788c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7891800640 1 -- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c0ae750 msgr2=0x7f788c1e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7891800640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c0ae750 0x7f788c1e7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7891800640 1 -- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f788c0d1050 msgr2=0x7f788c153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7891800640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f788c0d1050 0x7f788c153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7891800640 1 -- 172.21.15.2:0/3776444100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c1e9500 con 0x7f788c06d700 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7891800640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 0x7f788c13e130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f788000b3e0 tx=0x7f788000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880015020 con 0x7f788c06d700 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7880011830 con 0x7f788c06d700 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880011c20 con 0x7f788c06d700 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.617+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788c1e8460 con 0x7f788c06d700 2024-05-14T15:16:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.618+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c1e8a20 con 0x7f788c06d700 2024-05-14T15:16:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.619+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788c050870 con 0x7f788c06d700 2024-05-14T15:16:53.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.620+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7880018020 con 0x7f788c06d700 2024-05-14T15:16:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.621+0000 7f7889600640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f786c076300 0x7f786c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.621+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f7880097870 con 0x7f788c06d700 2024-05-14T15:16:53.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.622+0000 7f7890e00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f786c076300 0x7f786c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.623+0000 7f7890e00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f786c076300 0x7f786c078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f788c1533a0 tx=0x7f7878008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:53.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.626+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f788001f020 con 0x7f788c06d700 2024-05-14T15:16:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.878+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f788c074450 con 0x7f788c06d700 2024-05-14T15:16:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.879+0000 7f7889600640 1 -- 172.21.15.2:0/3776444100 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5174 (secure 0 0 0) 0x7f78800606e0 con 0x7f788c06d700 2024-05-14T15:16:53.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:53.879 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/2086857617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2086857617},{"type":"v1","addr":"172.21.15.2:6834","nonce":2086857617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3085437771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3085437771},{"type":"v1","addr":"172.21.15.2:6835","nonce":3085437771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3643836491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3643836491},{"type":"v1","addr":"172.21.15.156:6835","nonce":3643836491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:15:42.977951+0000","modified":"2024-05-14T15:16:08.184374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6837/218190176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":218190176},{"type":"v1","addr":"172.21.15.156:6837","nonce":218190176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-05-14T15:16:53.879 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f786c076300 msgr2=0x7f786c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f786c076300 0x7f786c078810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f788c1533a0 tx=0x7f7878008040 comp rx=0 tx=0).stop 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 msgr2=0x7f788c13e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 0x7f788c13e130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f788000b3e0 tx=0x7f788000b8a0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 shutdown_connections 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f786c076300 0x7f786c078810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f788c0d1050 0x7f788c153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f788c0ae750 0x7f788c1e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 --2- 172.21.15.2:0/3776444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c06d700 0x7f788c13e130 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 >> 172.21.15.2:0/3776444100 conn(0x7f788c0732e0 msgr2=0x7f788c0b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 shutdown_connections 2024-05-14T15:16:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:53.882+0000 7f7892c00640 1 -- 172.21.15.2:0/3776444100 wait complete. 2024-05-14T15:16:53.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:16:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.181+0000 7f0b50e00640 1 Processor -- start 2024-05-14T15:16:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.181+0000 7f0b50e00640 1 -- start start 2024-05-14T15:16:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b50e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c0b64e0 0x7f0b4c15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b50e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b4c06d700 0x7f0b4c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b50e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0b5ab0 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b50e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4c15cfc0 con 0x7f0b4c06d700 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b50e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c06e050 con 0x7f0b4c0b64e0 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b4b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0b4c0b56a0 0x7f0b4c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33454/0 (socket says 172.21.15.2:33454) 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b4b400640 1 -- 172.21.15.2:0/3186118730 learned_addr learned my addr 172.21.15.2:0/3186118730 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b4be00640 1 --2- 172.21.15.2:0/3186118730 >> v2:172.21.15.2:3300/0 conn(0x7f0b4c06d700 0x7f0b4c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.183+0000 7f0b4aa00640 1 --2- 172.21.15.2:0/3186118730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c0b64e0 0x7f0b4c15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.184+0000 7f0b4a000640 1 -- 172.21.15.2:0/3186118730 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785032095 0 0) 0x7f0b3c001110 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.184+0000 7f0b4be00640 1 -- 172.21.15.2:0/3186118730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c0b64e0 msgr2=0x7f0b4c15ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.184+0000 7f0b4be00640 1 --2- 172.21.15.2:0/3186118730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c0b64e0 0x7f0b4c15ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.184+0000 7f0b4be00640 1 -- 172.21.15.2:0/3186118730 >> v1:172.21.15.2:6789/0 conn(0x7f0b4c0b56a0 legacy=0x7f0b4c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.184+0000 7f0b4be00640 1 -- 172.21.15.2:0/3186118730 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0b0d10 con 0x7f0b4c06d700 2024-05-14T15:16:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.185+0000 7f0b4be00640 1 --2- 172.21.15.2:0/3186118730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c06d700 0x7f0b4c06db10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009df0 tx=0x7f0b4402a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bff4ad1bb40486 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.185+0000 7f0b4a000640 1 -- 172.21.15.2:0/3186118730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44007740 con 0x7f0b4c06d700 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.185+0000 7f0b4a000640 1 -- 172.21.15.2:0/3186118730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440078e0 con 0x7f0b4c06d700 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.185+0000 7f0b4a000640 1 -- 172.21.15.2:0/3186118730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44007cb0 con 0x7f0b4c06d700 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 -- 172.21.15.2:0/3186118730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c06d700 msgr2=0x7f0b4c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 --2- 172.21.15.2:0/3186118730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c06d700 0x7f0b4c06db10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009df0 tx=0x7f0b4402a6b0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 -- 172.21.15.2:0/3186118730 shutdown_connections 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 --2- 172.21.15.2:0/3186118730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c06d700 0x7f0b4c06db10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 --2- 172.21.15.2:0/3186118730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c0b64e0 0x7f0b4c15ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 -- 172.21.15.2:0/3186118730 >> 172.21.15.2:0/3186118730 conn(0x7f0b4c0732e0 msgr2=0x7f0b4c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 -- 172.21.15.2:0/3186118730 shutdown_connections 2024-05-14T15:16:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.186+0000 7f0b50e00640 1 -- 172.21.15.2:0/3186118730 wait complete. 2024-05-14T15:16:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.188+0000 7f0b50e00640 1 Processor -- start 2024-05-14T15:16:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.189+0000 7f0b50e00640 1 -- start start 2024-05-14T15:16:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b50e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c06d700 0x7f0b4c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b50e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 0x7f0b4c14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b50e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c0b64e0 0x7f0b4c148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b50e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0b5180 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b50e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0b4ea0 con 0x7f0b4c0b64e0 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b50e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c0b68f0 con 0x7f0b4c06d700 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 0x7f0b4c14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 0x7f0b4c14a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45500/0 (socket says 172.21.15.2:45500) 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 -- 172.21.15.2:0/2146728047 learned_addr learned my addr 172.21.15.2:0/2146728047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4b400640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c06d700 0x7f0b4c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4be00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c0b64e0 0x7f0b4c148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 -- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c06d700 msgr2=0x7f0b4c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c06d700 0x7f0b4c152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 -- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c0b64e0 msgr2=0x7f0b4c148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c0b64e0 0x7f0b4c148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.191+0000 7f0b4aa00640 1 -- 172.21.15.2:0/2146728047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c14ba20 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.192+0000 7f0b4aa00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 0x7f0b4c14a8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400d620 tx=0x7f0b3400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.192+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3400b620 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.192+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b34019070 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.192+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c149dd0 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.192+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3400ba00 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.192+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c15ede0 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.193+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c0d0da0 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.195+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b3400bba0 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.196+0000 7f0b43400640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0b280762d0 0x7f0b280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.196+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f0b34097e40 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.197+0000 7f0b4b400640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0b280762d0 0x7f0b280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.198+0000 7f0b4b400640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0b280762d0 0x7f0b280787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c000f60 tx=0x7f0b3c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.202+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0b34061390 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.420+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b4c14b7b0 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.422+0000 7f0b43400640 1 -- 172.21.15.2:0/2146728047 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18541 (secure 0 0 0) 0x7f0b34060c90 con 0x7f0b4c0b56a0 2024-05-14T15:16:54.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:16:54.427 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:16:29.950718+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:15:40.859291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:15:41.942717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:15:45.451703+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0b280762d0 msgr2=0x7f0b280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0b280762d0 0x7f0b280787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c000f60 tx=0x7f0b3c007c00 comp rx=0 tx=0).stop 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 msgr2=0x7f0b4c14a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 0x7f0b4c14a8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400d620 tx=0x7f0b3400dae0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 shutdown_connections 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0b280762d0 0x7f0b280787e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c0b64e0 0x7f0b4c148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b4c0b56a0 0x7f0b4c14a8b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 --2- 172.21.15.2:0/2146728047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c06d700 0x7f0b4c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.426+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 >> 172.21.15.2:0/2146728047 conn(0x7f0b4c0732e0 msgr2=0x7f0b4c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.427+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 shutdown_connections 2024-05-14T15:16:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.427+0000 7f0b50e00640 1 -- 172.21.15.2:0/2146728047 wait complete. 2024-05-14T15:16:54.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-14T15:16:54.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.745+0000 7f58dee00640 1 Processor -- start 2024-05-14T15:16:54.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.745+0000 7f58dee00640 1 -- start start 2024-05-14T15:16:54.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.747+0000 7f58dee00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d806f4e0 0x7f58d815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.747+0000 7f58dee00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 0x7f58d8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.747+0000 7f58dee00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80af720 con 0x7f58d809b410 2024-05-14T15:16:54.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.747+0000 7f58dee00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f58d8161590 con 0x7f58d81605a0 2024-05-14T15:16:54.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.747+0000 7f58dee00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f58d8160cf0 con 0x7f58d806f4e0 2024-05-14T15:16:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.748+0000 7f58dd000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 0x7f58d8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.748+0000 7f58dda00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d806f4e0 0x7f58d815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.748+0000 7f58dd000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 0x7f58d8070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:52912/0 (socket says 172.21.15.2:52912) 2024-05-14T15:16:54.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.748+0000 7f58dd000640 1 -- 172.21.15.2:0/870537356 learned_addr learned my addr 172.21.15.2:0/870537356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.749+0000 7f58dda00640 1 -- 172.21.15.2:0/870537356 >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 msgr2=0x7f58d8070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.749+0000 7f58dda00640 1 --2- 172.21.15.2:0/870537356 >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 0x7f58d8070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.749+0000 7f58dda00640 1 -- 172.21.15.2:0/870537356 >> v1:172.21.15.156:6789/0 conn(0x7f58d809b410 legacy=0x7f58d809b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.749+0000 7f58dda00640 1 -- 172.21.15.2:0/870537356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d8160fd0 con 0x7f58d806f4e0 2024-05-14T15:16:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.749+0000 7f58dd000640 1 --2- 172.21.15.2:0/870537356 >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 0x7f58d8070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.751+0000 7f58dda00640 1 --2- 172.21.15.2:0/870537356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d806f4e0 0x7f58d815a600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0097a0 tx=0x7f58cc02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e72585ab047c14 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.751+0000 7f58d7e00640 1 -- 172.21.15.2:0/870537356 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc037070 con 0x7f58d806f4e0 2024-05-14T15:16:54.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.751+0000 7f58d7e00640 1 -- 172.21.15.2:0/870537356 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc02ae40 con 0x7f58d806f4e0 2024-05-14T15:16:54.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.751+0000 7f58d7e00640 1 -- 172.21.15.2:0/870537356 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc032660 con 0x7f58d806f4e0 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 -- 172.21.15.2:0/870537356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d806f4e0 msgr2=0x7f58d815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 --2- 172.21.15.2:0/870537356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d806f4e0 0x7f58d815a600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0097a0 tx=0x7f58cc02a0f0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 -- 172.21.15.2:0/870537356 shutdown_connections 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 --2- 172.21.15.2:0/870537356 >> v2:172.21.15.156:3300/0 conn(0x7f58d81605a0 0x7f58d8070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 --2- 172.21.15.2:0/870537356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d806f4e0 0x7f58d815a600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 -- 172.21.15.2:0/870537356 >> 172.21.15.2:0/870537356 conn(0x7f58d80b7350 msgr2=0x7f58d80b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 -- 172.21.15.2:0/870537356 shutdown_connections 2024-05-14T15:16:54.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.752+0000 7f58dee00640 1 -- 172.21.15.2:0/870537356 wait complete. 2024-05-14T15:16:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.756+0000 7f58dee00640 1 Processor -- start 2024-05-14T15:16:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.756+0000 7f58dee00640 1 -- start start 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dee00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 0x7f58d81ea370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dee00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58d809b410 0x7f58d81ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dee00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d81605a0 0x7f58d81eadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dee00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8070ff0 con 0x7f58d806f4e0 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dee00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80d2430 con 0x7f58d809b410 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dee00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f58d81609b0 con 0x7f58d81605a0 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 0x7f58d81ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 0x7f58d81ea370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45514/0 (socket says 172.21.15.2:45514) 2024-05-14T15:16:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.758+0000 7f58dda00640 1 -- 172.21.15.2:0/62518651 learned_addr learned my addr 172.21.15.2:0/62518651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dd000640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58d809b410 0x7f58d81ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58de400640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d81605a0 0x7f58d81eadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dda00640 1 -- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d81605a0 msgr2=0x7f58d81eadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dda00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d81605a0 0x7f58d81eadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dda00640 1 -- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58d809b410 msgr2=0x7f58d81ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dda00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58d809b410 0x7f58d81ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dda00640 1 -- 172.21.15.2:0/62518651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d8155ab0 con 0x7f58d806f4e0 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58de400640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d81605a0 0x7f58d81eadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dd000640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58d809b410 0x7f58d81ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:54.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.759+0000 7f58dda00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 0x7f58d81ea370 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58cc02a130 tx=0x7f58cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.760+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc041070 con 0x7f58d806f4e0 2024-05-14T15:16:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.760+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc03c670 con 0x7f58d806f4e0 2024-05-14T15:16:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.760+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d81e9890 con 0x7f58d806f4e0 2024-05-14T15:16:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.760+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc037040 con 0x7f58d806f4e0 2024-05-14T15:16:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.760+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d81eb3f0 con 0x7f58d806f4e0 2024-05-14T15:16:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.761+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d80d1a10 con 0x7f58d806f4e0 2024-05-14T15:16:54.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.763+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58cc044070 con 0x7f58d806f4e0 2024-05-14T15:16:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.764+0000 7f58d5600640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58bc0762d0 0x7f58bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.764+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f58cc0b7c20 con 0x7f58d806f4e0 2024-05-14T15:16:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.765+0000 7f58dd000640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58bc0762d0 0x7f58bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.766+0000 7f58dd000640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58bc0762d0 0x7f58bc0787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58d813f940 tx=0x7f58c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:54.769+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58d80d1a10 con 0x7f58d806f4e0 2024-05-14T15:16:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.022+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f58d81eb650 con 0x7f58d806f4e0 2024-05-14T15:16:55.023 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-05-14T15:16:55.024+0000 7f9500200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T15:16:55.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.026+0000 7f58d5600640 1 -- 172.21.15.2:0/62518651 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f58cc081100 con 0x7f58d806f4e0 2024-05-14T15:16:55.026 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T15:16:55.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.029+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58bc0762d0 msgr2=0x7f58bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:55.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.029+0000 7f58dee00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58bc0762d0 0x7f58bc0787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58d813f940 tx=0x7f58c8008040 comp rx=0 tx=0).stop 2024-05-14T15:16:55.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 msgr2=0x7f58d81ea370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:55.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 0x7f58d81ea370 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58cc02a130 tx=0x7f58cc0046c0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 shutdown_connections 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f58bc0762d0 0x7f58bc0787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58d809b410 0x7f58d81ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58d81605a0 0x7f58d81eadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 --2- 172.21.15.2:0/62518651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58d806f4e0 0x7f58d81ea370 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 >> 172.21.15.2:0/62518651 conn(0x7f58d80b7350 msgr2=0x7f58d815fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 shutdown_connections 2024-05-14T15:16:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.031+0000 7f58dee00640 1 -- 172.21.15.2:0/62518651 wait complete. 2024-05-14T15:16:55.053 INFO:tasks.ceph.mds.b.smithi156.stderr: -4516> 2024-05-14T15:15:47.763+0000 7f8982c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T15:16:55.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T15:16:55.218 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2024-05-14T15:16:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.327+0000 7fd400c00640 1 Processor -- start 2024-05-14T15:16:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.327+0000 7fd400c00640 1 -- start start 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd400c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3fc0b1960 0x7fd3fc0cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd400c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cf010 0x7fd3fc0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd400c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3fc0d26b0 con 0x7fd3fc0b1d70 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd400c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fd3fc0d3210 con 0x7fd3fc0b1960 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd400c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd3fc06d140 con 0x7fd3fc0cf010 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd3f9400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd3fc0b1d70 0x7fd3fc0d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33466/0 (socket says 172.21.15.2:33466) 2024-05-14T15:16:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd3f9400640 1 -- 172.21.15.2:0/1904219926 learned_addr learned my addr 172.21.15.2:0/1904219926 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd3f9e00640 1 --2- 172.21.15.2:0/1904219926 >> v2:172.21.15.156:3300/0 conn(0x7fd3fc0b1960 0x7fd3fc0cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.329+0000 7fd3fa800640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cf010 0x7fd3fc0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874176444 0 0) 0x7fd3fc0d26b0 con 0x7fd3fc0b1d70 2024-05-14T15:16:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e0003520 con 0x7fd3fc0b1d70 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2518956647 0 0) 0x7fd3e0003520 con 0x7fd3fc0b1d70 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cf010 msgr2=0x7fd3fc0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cf010 0x7fd3fc0d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 >> v2:172.21.15.156:3300/0 conn(0x7fd3fc0b1960 msgr2=0x7fd3fc0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 --2- 172.21.15.2:0/1904219926 >> v2:172.21.15.156:3300/0 conn(0x7fd3fc0b1960 0x7fd3fc0cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc0d2970 con 0x7fd3fc0b1d70 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fd3e40016f0 con 0x7fd3fc0b1d70 2024-05-14T15:16:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 >> v1:172.21.15.2:6789/0 conn(0x7fd3fc0b1d70 legacy=0x7fd3fc0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e0003a00 0x7fd3e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e0005150 0x7fd3e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc0d3210 con 0x7fd3e0005150 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc06d140 con 0x7fd3e0004800 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.330+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e000bf50 con 0x7fd3e0003a00 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3fa800640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e0005150 0x7fd3e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3f9e00640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e0003a00 0x7fd3e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3f9400640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3fa800640 1 -- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e0003a00 msgr2=0x7fd3e0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3fa800640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e0003a00 0x7fd3e0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3fa800640 1 -- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0004800 msgr2=0x7fd3e0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3fa800640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3fa800640 1 -- 172.21.15.2:0/1904219926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e0003520 con 0x7fd3e0005150 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.331+0000 7fd3f9400640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0004800 0x7fd3e0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.332+0000 7fd3fa800640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e0005150 0x7fd3e000b9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009fc0 tx=0x7fd3e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901b48301dd5cd3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.332+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4034020 con 0x7fd3e0005150 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.332+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f40305f0 con 0x7fd3e0005150 2024-05-14T15:16:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.333+0000 7fd3f8a00640 1 -- 172.21.15.2:0/1904219926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4009c10 con 0x7fd3e0005150 2024-05-14T15:16:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.333+0000 7fd400c00640 1 -- 172.21.15.2:0/1904219926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e0005150 msgr2=0x7fd3e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.333+0000 7fd400c00640 1 --2- 172.21.15.2:0/1904219926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e0005150 0x7fd3e000b9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009fc0 tx=0x7fd3e0005830 comp rx=0 tx=0).stop 2024-05-14T15:16:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.333+0000 7fd3fa800640 1 -- 172.21.15.2:0/1904219926 reap_dead start 2024-05-14T15:16:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.333+0000 7fd400c00640 1 -- 172.21.15.2:0/1904219926 shutdown_connections 2024-05-14T15:16:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.333+0000 7fd400c00640 1 -- 172.21.15.2:0/1904219926 >> 172.21.15.2:0/1904219926 conn(0x7fd3fc0b7550 msgr2=0x7fd3fc0b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.334+0000 7fd400c00640 1 -- 172.21.15.2:0/1904219926 shutdown_connections 2024-05-14T15:16:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.334+0000 7fd400c00640 1 -- 172.21.15.2:0/1904219926 wait complete. 2024-05-14T15:16:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.336+0000 7fd400c00640 1 Processor -- start 2024-05-14T15:16:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.336+0000 7fd400c00640 1 -- start start 2024-05-14T15:16:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd400c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0005150 0x7fd3fc1e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd400c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cb820 0x7fd3fc1e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd400c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 0x7fd3fc15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd400c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc0cf010 con 0x7fd3fc157150 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd400c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc0d2f30 con 0x7fd3e0005150 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd400c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd3fc0cf190 con 0x7fd3fc0cb820 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd3fa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 0x7fd3fc15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd3fa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 0x7fd3fc15d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45534/0 (socket says 172.21.15.2:45534) 2024-05-14T15:16:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.338+0000 7fd3fa800640 1 -- 172.21.15.2:0/818948259 learned_addr learned my addr 172.21.15.2:0/818948259 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3f9400640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cb820 0x7fd3fc1e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3f9e00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0005150 0x7fd3fc1e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3fa800640 1 -- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cb820 msgr2=0x7fd3fc1e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3fa800640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cb820 0x7fd3fc1e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3fa800640 1 -- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0005150 msgr2=0x7fd3fc1e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3fa800640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0005150 0x7fd3fc1e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3fa800640 1 -- 172.21.15.2:0/818948259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc0c9d80 con 0x7fd3fc157150 2024-05-14T15:16:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3fa800640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 0x7fd3fc15d640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400e230 tx=0x7fd3f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.339+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4040070 con 0x7fd3fc157150 2024-05-14T15:16:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.340+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f4003990 con 0x7fd3fc157150 2024-05-14T15:16:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.340+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4034040 con 0x7fd3fc157150 2024-05-14T15:16:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.340+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3fc0ca060 con 0x7fd3fc157150 2024-05-14T15:16:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.340+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3fc0ca620 con 0x7fd3fc157150 2024-05-14T15:16:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.341+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3fc0c9ad0 con 0x7fd3fc157150 2024-05-14T15:16:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.342+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd3f4037020 con 0x7fd3fc157150 2024-05-14T15:16:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.344+0000 7fd3f2000640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd3d80762d0 0x7fd3d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.344+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fd3f40b7e80 con 0x7fd3fc157150 2024-05-14T15:16:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.345+0000 7fd3f9e00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd3d80762d0 0x7fd3d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.346+0000 7fd3f9e00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd3d80762d0 0x7fd3d80787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009a10 tx=0x7fd3ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.349+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd3f4081370 con 0x7fd3fc157150 2024-05-14T15:16:55.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:55.606+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd3fc050870 con 0x7fd3fc157150 2024-05-14T15:16:56.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.116+0000 7fd3f2000640 1 -- 172.21.15.2:0/818948259 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fd3f4087020 con 0x7fd3fc157150 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.119+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd3d80762d0 msgr2=0x7fd3d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.119+0000 7fd400c00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd3d80762d0 0x7fd3d80787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009a10 tx=0x7fd3ec008040 comp rx=0 tx=0).stop 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.119+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 msgr2=0x7fd3fc15d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.119+0000 7fd400c00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 0x7fd3fc15d640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400e230 tx=0x7fd3f4009750 comp rx=0 tx=0).stop 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 shutdown_connections 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd3d80762d0 0x7fd3d80787e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3fc157150 0x7fd3fc15d640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3fc0cb820 0x7fd3fc1e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 --2- 172.21.15.2:0/818948259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0005150 0x7fd3fc1e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 >> 172.21.15.2:0/818948259 conn(0x7fd3fc0b7550 msgr2=0x7fd3fc070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 shutdown_connections 2024-05-14T15:16:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.120+0000 7fd400c00640 1 -- 172.21.15.2:0/818948259 wait complete. 2024-05-14T15:16:56.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T15:16:56.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.433+0000 7f37db200640 1 Processor -- start 2024-05-14T15:16:56.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.434+0000 7f37db200640 1 -- start start 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.436+0000 7f37db200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f37d40af760 0x7f37d4168c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.436+0000 7f37db200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d41618d0 con 0x7f37d406d700 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.436+0000 7f37db200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d4161bb0 con 0x7f37d40d1050 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.436+0000 7f37db200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f37d41624e0 con 0x7f37d40af760 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.437+0000 7f37da800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f37d40af760 0x7f37d4168c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.437+0000 7f37d9400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f37d406d700 0x7f37d406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33468/0 (socket says 172.21.15.2:33468) 2024-05-14T15:16:56.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.437+0000 7f37d9400640 1 -- 172.21.15.2:0/2992970178 learned_addr learned my addr 172.21.15.2:0/2992970178 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.437+0000 7f37da800640 1 -- 172.21.15.2:0/2992970178 >> v1:172.21.15.156:6789/0 conn(0x7f37d40d1050 legacy=0x7f37d4070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.437+0000 7f37da800640 1 -- 172.21.15.2:0/2992970178 >> v1:172.21.15.2:6789/0 conn(0x7f37d406d700 legacy=0x7f37d406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.437+0000 7f37da800640 1 -- 172.21.15.2:0/2992970178 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d4161e90 con 0x7f37d40af760 2024-05-14T15:16:56.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.439+0000 7f37da800640 1 --2- 172.21.15.2:0/2992970178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d40af760 0x7f37d4168c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009d90 tx=0x7f37d002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af5a1297c7b3cfd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:56.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.439+0000 7f37d8a00640 1 -- 172.21.15.2:0/2992970178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0007740 con 0x7f37d40af760 2024-05-14T15:16:56.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.439+0000 7f37d8a00640 1 -- 172.21.15.2:0/2992970178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d00078e0 con 0x7f37d40af760 2024-05-14T15:16:56.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.439+0000 7f37d8a00640 1 -- 172.21.15.2:0/2992970178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0007cb0 con 0x7f37d40af760 2024-05-14T15:16:56.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 -- 172.21.15.2:0/2992970178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d40af760 msgr2=0x7f37d4168c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 --2- 172.21.15.2:0/2992970178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d40af760 0x7f37d4168c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009d90 tx=0x7f37d002a6f0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 -- 172.21.15.2:0/2992970178 shutdown_connections 2024-05-14T15:16:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 --2- 172.21.15.2:0/2992970178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d40af760 0x7f37d4168c60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 -- 172.21.15.2:0/2992970178 >> 172.21.15.2:0/2992970178 conn(0x7f37d40732e0 msgr2=0x7f37d40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 -- 172.21.15.2:0/2992970178 shutdown_connections 2024-05-14T15:16:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.440+0000 7f37db200640 1 -- 172.21.15.2:0/2992970178 wait complete. 2024-05-14T15:16:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.442+0000 7f37db200640 1 Processor -- start 2024-05-14T15:16:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.443+0000 7f37db200640 1 -- start start 2024-05-14T15:16:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.444+0000 7f37db200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 0x7f37d4152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.444+0000 7f37db200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37d40d1050 0x7f37d4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.444+0000 7f37db200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37d4153040 0x7f37d40b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.444+0000 7f37db200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37d415f110 con 0x7f37d406d700 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.444+0000 7f37db200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f37d4071050 con 0x7f37d4153040 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.444+0000 7f37db200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f37d415f290 con 0x7f37d40d1050 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 0x7f37d4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 0x7f37d4152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45554/0 (socket says 172.21.15.2:45554) 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 -- 172.21.15.2:0/3485308786 learned_addr learned my addr 172.21.15.2:0/3485308786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 -- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37d40d1050 msgr2=0x7f37d4152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37d40d1050 0x7f37d4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37da800640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37d4153040 0x7f37d40b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 -- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37d4153040 msgr2=0x7f37d40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37d4153040 0x7f37d40b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.445+0000 7f37d9e00640 1 -- 172.21.15.2:0/3485308786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d41528b0 con 0x7f37d406d700 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.446+0000 7f37d9e00640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 0x7f37d4152370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37c800c3d0 tx=0x7f37c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.446+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8017070 con 0x7f37d406d700 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.446+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c80052d0 con 0x7f37d406d700 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.446+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d4153830 con 0x7f37d406d700 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.446+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80037f0 con 0x7f37d406d700 2024-05-14T15:16:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.446+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d40cfcb0 con 0x7f37d406d700 2024-05-14T15:16:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.447+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d4050870 con 0x7f37d406d700 2024-05-14T15:16:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.449+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37c801a070 con 0x7f37d406d700 2024-05-14T15:16:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.450+0000 7f37ce000640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f37b80762d0 0x7f37b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.450+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7f37c8096d00 con 0x7f37d406d700 2024-05-14T15:16:56.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.450+0000 7f37d9400640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f37b80762d0 0x7f37b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.452+0000 7f37d9400640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f37b80762d0 0x7f37b80787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f37c4005880 tx=0x7f37c4007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.454+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37c805fb10 con 0x7f37d406d700 2024-05-14T15:16:56.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:56.664+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37d4074450 con 0x7f37d406d700 2024-05-14T15:16:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.129+0000 7f37ce000640 1 -- 172.21.15.2:0/3485308786 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7f37c80681e0 con 0x7f37d406d700 2024-05-14T15:16:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-05-14T15:16:57.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f37b80762d0 msgr2=0x7f37b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f37b80762d0 0x7f37b80787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f37c4005880 tx=0x7f37c4007a20 comp rx=0 tx=0).stop 2024-05-14T15:16:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 msgr2=0x7f37d4152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 0x7f37d4152370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37c800c3d0 tx=0x7f37c800c890 comp rx=0 tx=0).stop 2024-05-14T15:16:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 shutdown_connections 2024-05-14T15:16:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f37b80762d0 0x7f37b80787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37d4153040 0x7f37d40b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37d40d1050 0x7f37d4152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 --2- 172.21.15.2:0/3485308786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37d406d700 0x7f37d4152370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 >> 172.21.15.2:0/3485308786 conn(0x7f37d40732e0 msgr2=0x7f37d40ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 shutdown_connections 2024-05-14T15:16:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.133+0000 7f37db200640 1 -- 172.21.15.2:0/3485308786 wait complete. 2024-05-14T15:16:57.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T15:16:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.463+0000 7feb48e00640 1 Processor -- start 2024-05-14T15:16:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.464+0000 7feb48e00640 1 -- start start 2024-05-14T15:16:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.466+0000 7feb48e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb4406d700 0x7feb4406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.466+0000 7feb48e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb440ae750 0x7feb440aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.466+0000 7feb48e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb4406e050 con 0x7feb440d1050 2024-05-14T15:16:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.466+0000 7feb48e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7feb441624e0 con 0x7feb440ae750 2024-05-14T15:16:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.466+0000 7feb48e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7feb441618d0 con 0x7feb4406d700 2024-05-14T15:16:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb440ae750 0x7feb440aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb440ae750 0x7feb440aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45562/0 (socket says 172.21.15.2:45562) 2024-05-14T15:16:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 -- 172.21.15.2:0/2740793767 learned_addr learned my addr 172.21.15.2:0/2740793767 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb42a00640 1 --2- 172.21.15.2:0/2740793767 >> v2:172.21.15.156:3300/0 conn(0x7feb4406d700 0x7feb4406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 -- 172.21.15.2:0/2740793767 >> v2:172.21.15.156:3300/0 conn(0x7feb4406d700 msgr2=0x7feb4406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 --2- 172.21.15.2:0/2740793767 >> v2:172.21.15.156:3300/0 conn(0x7feb4406d700 0x7feb4406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 -- 172.21.15.2:0/2740793767 >> v1:172.21.15.156:6789/0 conn(0x7feb440d1050 legacy=0x7feb44070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.467+0000 7feb43e00640 1 -- 172.21.15.2:0/2740793767 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb44161bb0 con 0x7feb440ae750 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.468+0000 7feb43e00640 1 --2- 172.21.15.2:0/2740793767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb440aeb60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb4409faa0 tx=0x7feb3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ce76f1548f100d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.469+0000 7feb42000640 1 -- 172.21.15.2:0/2740793767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c036070 con 0x7feb440ae750 2024-05-14T15:16:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.469+0000 7feb42000640 1 -- 172.21.15.2:0/2740793767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c031600 con 0x7feb440ae750 2024-05-14T15:16:57.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.469+0000 7feb42000640 1 -- 172.21.15.2:0/2740793767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0319d0 con 0x7feb440ae750 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 -- 172.21.15.2:0/2740793767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 msgr2=0x7feb440aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 --2- 172.21.15.2:0/2740793767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb440aeb60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb4409faa0 tx=0x7feb3c02a6a0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 -- 172.21.15.2:0/2740793767 shutdown_connections 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 --2- 172.21.15.2:0/2740793767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb440aeb60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 --2- 172.21.15.2:0/2740793767 >> v2:172.21.15.156:3300/0 conn(0x7feb4406d700 0x7feb4406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 -- 172.21.15.2:0/2740793767 >> 172.21.15.2:0/2740793767 conn(0x7feb440732e0 msgr2=0x7feb440736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 -- 172.21.15.2:0/2740793767 shutdown_connections 2024-05-14T15:16:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.470+0000 7feb48e00640 1 -- 172.21.15.2:0/2740793767 wait complete. 2024-05-14T15:16:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.473+0000 7feb48e00640 1 Processor -- start 2024-05-14T15:16:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.474+0000 7feb48e00640 1 -- start start 2024-05-14T15:16:57.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb48e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb4406d700 0x7feb44145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb48e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb44148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb48e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb440d1050 0x7feb44149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb48e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feb44071050 con 0x7feb440ae750 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb48e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7feb44162170 con 0x7feb440d1050 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb48e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7feb4415f110 con 0x7feb4406d700 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb42a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb44148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb42a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb44148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45572/0 (socket says 172.21.15.2:45572) 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.476+0000 7feb42a00640 1 -- 172.21.15.2:0/4022157814 learned_addr learned my addr 172.21.15.2:0/4022157814 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb43400640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb4406d700 0x7feb44145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb43e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb440d1050 0x7feb44149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb42a00640 1 -- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb4406d700 msgr2=0x7feb44145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb42a00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb4406d700 0x7feb44145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb42a00640 1 -- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb440d1050 msgr2=0x7feb44149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb42a00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb440d1050 0x7feb44149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb42a00640 1 -- 172.21.15.2:0/4022157814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb441ea4c0 con 0x7feb440ae750 2024-05-14T15:16:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb43400640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb4406d700 0x7feb44145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb43e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb440d1050 0x7feb44149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb42a00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb44148b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c7f0 tx=0x7feb3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30015070 con 0x7feb440ae750 2024-05-14T15:16:57.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.477+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb30004220 con 0x7feb440ae750 2024-05-14T15:16:57.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.478+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb44143720 con 0x7feb440ae750 2024-05-14T15:16:57.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.478+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30007620 con 0x7feb440ae750 2024-05-14T15:16:57.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.478+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb441439c0 con 0x7feb440ae750 2024-05-14T15:16:57.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.479+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb440b0670 con 0x7feb440ae750 2024-05-14T15:16:57.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.480+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb300079d0 con 0x7feb440ae750 2024-05-14T15:16:57.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.481+0000 7feb3b400640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feb240762d0 0x7feb240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:57.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.482+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6238+0+0 (secure 0 0 0) 0x7feb30097b80 con 0x7feb440ae750 2024-05-14T15:16:57.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.482+0000 7feb43400640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feb240762d0 0x7feb240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:57.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.484+0000 7feb43400640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feb240762d0 0x7feb240787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb44074f20 tx=0x7feb34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:57.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.487+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb440b0670 con 0x7feb440ae750 2024-05-14T15:16:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:57.703+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7feb441e9f70 con 0x7feb440ae750 2024-05-14T15:16:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.159+0000 7feb3b400640 1 -- 172.21.15.2:0/4022157814 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7feb300612d0 con 0x7feb440ae750 2024-05-14T15:16:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feb240762d0 msgr2=0x7feb240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feb240762d0 0x7feb240787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb44074f20 tx=0x7feb34008040 comp rx=0 tx=0).stop 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 msgr2=0x7feb44148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb44148b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c7f0 tx=0x7feb3000ccb0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 shutdown_connections 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7feb240762d0 0x7feb240787e0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb44074f20 tx=0x7feb34008040 comp rx=0 tx=0).stop 2024-05-14T15:16:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb440d1050 0x7feb44149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440ae750 0x7feb44148b00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 --2- 172.21.15.2:0/4022157814 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb4406d700 0x7feb44145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.167+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 >> 172.21.15.2:0/4022157814 conn(0x7feb440732e0 msgr2=0x7feb4406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:58.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.168+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 shutdown_connections 2024-05-14T15:16:58.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.168+0000 7feb48e00640 1 -- 172.21.15.2:0/4022157814 wait complete. 2024-05-14T15:16:58.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-14T15:16:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.480+0000 7f93cd600640 1 Processor -- start 2024-05-14T15:16:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.481+0000 7f93cd600640 1 -- start start 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93cd600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93c80b6340 0x7f93c8160900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93cd600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f93c806feb0 0x7f93c806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93cd600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c8070c90 con 0x7f93c806dc40 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93cd600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f93c8074510 con 0x7f93c80b6340 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93cd600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f93c8160e40 con 0x7f93c806feb0 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93ccc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f93c806dc40 0x7f93c8073e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33478/0 (socket says 172.21.15.2:33478) 2024-05-14T15:16:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93ccc00640 1 -- 172.21.15.2:0/1150600801 learned_addr learned my addr 172.21.15.2:0/1150600801 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:16:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.483+0000 7f93c7e00640 1 --2- 172.21.15.2:0/1150600801 >> v2:172.21.15.2:3300/0 conn(0x7f93c80b6340 0x7f93c8160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.484+0000 7f93c7400640 1 --2- 172.21.15.2:0/1150600801 >> v2:172.21.15.156:3300/0 conn(0x7f93c806feb0 0x7f93c806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.484+0000 7f93c7e00640 1 -- 172.21.15.2:0/1150600801 >> v2:172.21.15.156:3300/0 conn(0x7f93c806feb0 msgr2=0x7f93c806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.484+0000 7f93c7e00640 1 --2- 172.21.15.2:0/1150600801 >> v2:172.21.15.156:3300/0 conn(0x7f93c806feb0 0x7f93c806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.484+0000 7f93c7e00640 1 -- 172.21.15.2:0/1150600801 >> v1:172.21.15.2:6789/0 conn(0x7f93c806dc40 legacy=0x7f93c8073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.484+0000 7f93c7e00640 1 -- 172.21.15.2:0/1150600801 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c806e050 con 0x7f93c80b6340 2024-05-14T15:16:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.484+0000 7f93c6a00640 1 -- 172.21.15.2:0/1150600801 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736578621 0 0) 0x7f93c0001110 con 0x7f93c806dc40 2024-05-14T15:16:58.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.486+0000 7f93c7e00640 1 --2- 172.21.15.2:0/1150600801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8160900 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93c815fe50 tx=0x7f93b802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1899bcb9c83e4ce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.486+0000 7f93c6a00640 1 -- 172.21.15.2:0/1150600801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8007740 con 0x7f93c80b6340 2024-05-14T15:16:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.486+0000 7f93c6a00640 1 -- 172.21.15.2:0/1150600801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b80078e0 con 0x7f93c80b6340 2024-05-14T15:16:58.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.486+0000 7f93c6a00640 1 -- 172.21.15.2:0/1150600801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8007cb0 con 0x7f93c80b6340 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 -- 172.21.15.2:0/1150600801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 msgr2=0x7f93c8160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 --2- 172.21.15.2:0/1150600801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8160900 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93c815fe50 tx=0x7f93b802a680 comp rx=0 tx=0).stop 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 -- 172.21.15.2:0/1150600801 shutdown_connections 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 --2- 172.21.15.2:0/1150600801 >> v2:172.21.15.156:3300/0 conn(0x7f93c806feb0 0x7f93c806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 --2- 172.21.15.2:0/1150600801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8160900 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 -- 172.21.15.2:0/1150600801 >> 172.21.15.2:0/1150600801 conn(0x7f93c80732e0 msgr2=0x7f93c80736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 -- 172.21.15.2:0/1150600801 shutdown_connections 2024-05-14T15:16:58.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.487+0000 7f93cd600640 1 -- 172.21.15.2:0/1150600801 wait complete. 2024-05-14T15:16:58.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.490+0000 7f93cd600640 1 Processor -- start 2024-05-14T15:16:58.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.491+0000 7f93cd600640 1 -- start start 2024-05-14T15:16:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93cd600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c806dc40 0x7f93c8146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93cd600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c806feb0 0x7f93c81532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93cd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93cd600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93c806fa20 con 0x7f93c80b6340 2024-05-14T15:16:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93cd600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f93c806f180 con 0x7f93c806dc40 2024-05-14T15:16:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93cd600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f93c806f3d0 con 0x7f93c806feb0 2024-05-14T15:16:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93ccc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93ccc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45584/0 (socket says 172.21.15.2:45584) 2024-05-14T15:16:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93ccc00640 1 -- 172.21.15.2:0/2408382535 learned_addr learned my addr 172.21.15.2:0/2408382535 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.493+0000 7f93c7400640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c806feb0 0x7f93c81532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93c7e00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c806dc40 0x7f93c8146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93ccc00640 1 -- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c806feb0 msgr2=0x7f93c81532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93ccc00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c806feb0 0x7f93c81532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93ccc00640 1 -- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c806dc40 msgr2=0x7f93c8146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93ccc00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c806dc40 0x7f93c8146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93ccc00640 1 -- 172.21.15.2:0/2408382535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c814fdc0 con 0x7f93c80b6340 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93c7e00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c806dc40 0x7f93c8146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.494+0000 7f93ccc00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8154de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93c000c3f0 tx=0x7f93c000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.495+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c00074e0 con 0x7f93c80b6340 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.495+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c00047e0 con 0x7f93c80b6340 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.495+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0004bd0 con 0x7f93c80b6340 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.495+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c8153d20 con 0x7f93c80b6340 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.495+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c8154000 con 0x7f93c80b6340 2024-05-14T15:16:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.496+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c8050870 con 0x7f93c80b6340 2024-05-14T15:16:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.498+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93c0011070 con 0x7f93c80b6340 2024-05-14T15:16:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.499+0000 7f93bfe00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93a80762d0 0x7f93a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.499+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7f93c0096fd0 con 0x7f93c80b6340 2024-05-14T15:16:58.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.499+0000 7f93c7e00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93a80762d0 0x7f93a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.501+0000 7f93c7e00640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93a80762d0 0x7f93a80787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f93b8034000 tx=0x7f93b8033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:58.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.504+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93c8070c90 con 0x7f93c80b6340 2024-05-14T15:16:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:58.714+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93c80b6120 con 0x7f93c80b6340 2024-05-14T15:16:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.171+0000 7f93bfe00640 1 -- 172.21.15.2:0/2408382535 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f93c0060990 con 0x7f93c80b6340 2024-05-14T15:16:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' removed 2024-05-14T15:16:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.175+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93a80762d0 msgr2=0x7f93a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:59.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.175+0000 7f93cd600640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93a80762d0 0x7f93a80787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f93b8034000 tx=0x7f93b8033040 comp rx=0 tx=0).stop 2024-05-14T15:16:59.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.175+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 msgr2=0x7f93c8154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:59.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.175+0000 7f93cd600640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8154de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93c000c3f0 tx=0x7f93c000c8b0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.177+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 shutdown_connections 2024-05-14T15:16:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.177+0000 7f93cd600640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f93a80762d0 0x7f93a80787e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.177+0000 7f93cd600640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c80b6340 0x7f93c8154de0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.177+0000 7f93cd600640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c806feb0 0x7f93c81532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.177+0000 7f93cd600640 1 --2- 172.21.15.2:0/2408382535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c806dc40 0x7f93c8146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.177+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 >> 172.21.15.2:0/2408382535 conn(0x7f93c80732e0 msgr2=0x7f93c80afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:59.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.178+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 shutdown_connections 2024-05-14T15:16:59.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.178+0000 7f93cd600640 1 -- 172.21.15.2:0/2408382535 wait complete. 2024-05-14T15:16:59.207 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T15:16:59.207 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-14T15:16:59.208 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-14T15:16:59.208 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:59.208 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T15:16:59.208 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-14T15:16:59.208 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-14T15:16:59.208 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:59.209 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T15:16:59.209 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-14T15:16:59.209 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-14T15:16:59.209 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:59.209 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T15:16:59.209 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-14T15:16:59.209 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-14T15:16:59.209 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:16:59.233 INFO:tasks.ceph.mds.a:Stopped 2024-05-14T15:16:59.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-14T15:16:59.235 INFO:tasks.ceph.mds.d:Stopped 2024-05-14T15:16:59.235 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-14T15:16:59.236 INFO:tasks.ceph.mds.c:Stopped 2024-05-14T15:16:59.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-14T15:16:59.237 INFO:tasks.ceph.mds.b:Stopped 2024-05-14T15:16:59.237 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-14T15:16:59.283 INFO:tasks.ceph.mds.d:Started 2024-05-14T15:16:59.284 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:59.284 INFO:tasks.ceph.mds.a:Started 2024-05-14T15:16:59.285 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:59.288 INFO:tasks.ceph.mds.b:Started 2024-05-14T15:16:59.289 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:59.290 INFO:tasks.ceph.mds.c:Started 2024-05-14T15:16:59.291 DEBUG:teuthology.parallel:result is None 2024-05-14T15:16:59.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-14T15:16:59.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-05-14T15:16:59.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-14T15:16:59.511 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2024-05-14T15:16:59.512 INFO:tasks.ceph.mds.d.smithi156.stdout:starting mds.d at 2024-05-14T15:16:59.517 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-05-14T15:16:59.521 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-05-14T15:16:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.552+0000 7fe1dd200640 1 Processor -- start 2024-05-14T15:16:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.552+0000 7fe1dd200640 1 -- start start 2024-05-14T15:16:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.554+0000 7fe1dd200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.554+0000 7fe1dd200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe1d80b47e0 0x7fe1d80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.554+0000 7fe1dd200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 0x7fe1d80cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.554+0000 7fe1dd200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d815f5b0 con 0x7fe1d80cfb40 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.554+0000 7fe1dd200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d80b5130 con 0x7fe1d80b47e0 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.554+0000 7fe1dd200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d815e7f0 con 0x7fe1d80d0ff0 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d6800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 0x7fe1d80cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d6800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 0x7fe1d80cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45632/0 (socket says 172.21.15.2:45632) 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d6800640 1 -- 172.21.15.2:0/1378667818 learned_addr learned my addr 172.21.15.2:0/1378667818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/1378667818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1cfe00640 1 --2- 172.21.15.2:0/1378667818 >> v2:172.21.15.156:3300/0 conn(0x7fe1d80b47e0 0x7fe1d80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d5e00640 1 -- 172.21.15.2:0/1378667818 >> v2:172.21.15.156:3300/0 conn(0x7fe1d80b47e0 msgr2=0x7fe1d80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/1378667818 >> v2:172.21.15.156:3300/0 conn(0x7fe1d80b47e0 0x7fe1d80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d5e00640 1 -- 172.21.15.2:0/1378667818 >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 msgr2=0x7fe1d80cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/1378667818 >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 0x7fe1d80cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d5e00640 1 -- 172.21.15.2:0/1378667818 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d815ead0 con 0x7fe1d80d0ff0 2024-05-14T15:16:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.555+0000 7fe1d6800640 1 --2- 172.21.15.2:0/1378667818 >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 0x7fe1d80cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.557+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/1378667818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81625e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80731d0 tx=0x7fe1c802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2879f8fa9daad4ba server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.557+0000 7fe1d5400640 1 -- 172.21.15.2:0/1378667818 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8037070 con 0x7fe1d80d0ff0 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.557+0000 7fe1d5400640 1 -- 172.21.15.2:0/1378667818 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c8032440 con 0x7fe1d80d0ff0 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.557+0000 7fe1d5400640 1 -- 172.21.15.2:0/1378667818 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c802ae60 con 0x7fe1d80d0ff0 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 -- 172.21.15.2:0/1378667818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 msgr2=0x7fe1d81625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 --2- 172.21.15.2:0/1378667818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81625e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80731d0 tx=0x7fe1c802a110 comp rx=0 tx=0).stop 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 -- 172.21.15.2:0/1378667818 shutdown_connections 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 --2- 172.21.15.2:0/1378667818 >> v2:172.21.15.2:3300/0 conn(0x7fe1d80cfb40 0x7fe1d80cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 --2- 172.21.15.2:0/1378667818 >> v2:172.21.15.156:3300/0 conn(0x7fe1d80b47e0 0x7fe1d80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 --2- 172.21.15.2:0/1378667818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81625e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 -- 172.21.15.2:0/1378667818 >> 172.21.15.2:0/1378667818 conn(0x7fe1d80ce230 msgr2=0x7fe1d80ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 -- 172.21.15.2:0/1378667818 shutdown_connections 2024-05-14T15:16:59.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.558+0000 7fe1dd200640 1 -- 172.21.15.2:0/1378667818 wait complete. 2024-05-14T15:16:59.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.560+0000 7fe1dd200640 1 Processor -- start 2024-05-14T15:16:59.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.560+0000 7fe1dd200640 1 -- start start 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1dd200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1d80b47e0 0x7fe1d8157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1dd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 0x7fe1d81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1dd200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1dd200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8071640 con 0x7fe1d80cfb40 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1dd200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d815f090 con 0x7fe1d80b47e0 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1dd200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d815be80 con 0x7fe1d80d0ff0 2024-05-14T15:16:59.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1cfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 0x7fe1d81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1cfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 0x7fe1d81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45644/0 (socket says 172.21.15.2:45644) 2024-05-14T15:16:59.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1cfe00640 1 -- 172.21.15.2:0/2665755045 learned_addr learned my addr 172.21.15.2:0/2665755045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:16:59.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.562+0000 7fe1d6800640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1d80b47e0 0x7fe1d8157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1cfe00640 1 -- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 msgr2=0x7fe1d81570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1cfe00640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1cfe00640 1 -- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1d80b47e0 msgr2=0x7fe1d8157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1cfe00640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1d80b47e0 0x7fe1d8157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1cfe00640 1 -- 172.21.15.2:0/2665755045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d81507e0 con 0x7fe1d80cfb40 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.563+0000 7fe1cfe00640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 0x7fe1d81502a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000e870 tx=0x7fe1c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.564+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0017070 con 0x7fe1d80cfb40 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.564+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c000ee60 con 0x7fe1d80cfb40 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.564+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d81587b0 con 0x7fe1d80cfb40 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.564+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000cb80 con 0x7fe1d80cfb40 2024-05-14T15:16:59.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.564+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d8158d70 con 0x7fe1d80cfb40 2024-05-14T15:16:59.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.565+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d8158500 con 0x7fe1d80cfb40 2024-05-14T15:16:59.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.566+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe1c001a070 con 0x7fe1d80cfb40 2024-05-14T15:16:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.567+0000 7fe1ce000640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe1b4076300 0x7fe1b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.567+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7fe1c0097210 con 0x7fe1d80cfb40 2024-05-14T15:16:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.568+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe1b4076300 0x7fe1b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.569+0000 7fe1d5e00640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe1b4076300 0x7fe1b4078810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8034000 tx=0x7fe1c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.572+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe1c00605f0 con 0x7fe1d80cfb40 2024-05-14T15:16:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:16:59.794+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe1d8050870 con 0x7fe1d80cfb40 2024-05-14T15:17:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.203+0000 7fe1ce000640 1 -- 172.21.15.2:0/2665755045 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7fe1c00648f0 con 0x7fe1d80cfb40 2024-05-14T15:17:00.202 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2024-05-14T15:17:00.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe1b4076300 msgr2=0x7fe1b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe1b4076300 0x7fe1b4078810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8034000 tx=0x7fe1c802e000 comp rx=0 tx=0).stop 2024-05-14T15:17:00.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 msgr2=0x7fe1d81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 0x7fe1d81502a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000e870 tx=0x7fe1c000ed30 comp rx=0 tx=0).stop 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 shutdown_connections 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fe1b4076300 0x7fe1b4078810 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1d80d0ff0 0x7fe1d81570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1d80cfb40 0x7fe1d81502a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 --2- 172.21.15.2:0/2665755045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1d80b47e0 0x7fe1d8157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.207+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 >> 172.21.15.2:0/2665755045 conn(0x7fe1d80ce230 msgr2=0x7fe1d80b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.208+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 shutdown_connections 2024-05-14T15:17:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.208+0000 7fe1dd200640 1 -- 172.21.15.2:0/2665755045 wait complete. 2024-05-14T15:17:00.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-14T15:17:00.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.487+0000 7f75c3e00640 1 Processor -- start 2024-05-14T15:17:00.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.487+0000 7f75c3e00640 1 -- start start 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.489+0000 7f75c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75c415bb40 0x7f75c40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.489+0000 7f75c3e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c41619d0 con 0x7f75c40cece0 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.489+0000 7f75c3e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c4161cb0 con 0x7f75c4073670 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.489+0000 7f75c3e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f75c41625e0 con 0x7f75c415bb40 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.489+0000 7f75c2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75c415bb40 0x7f75c40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.490+0000 7f75c2000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f75c40cece0 0x7f75c4072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33586/0 (socket says 172.21.15.2:33586) 2024-05-14T15:17:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.490+0000 7f75c2000640 1 -- 172.21.15.2:0/1011792170 learned_addr learned my addr 172.21.15.2:0/1011792170 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:00.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.490+0000 7f75c2a00640 1 -- 172.21.15.2:0/1011792170 >> v1:172.21.15.156:6789/0 conn(0x7f75c4073670 legacy=0x7f75c40b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:00.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.490+0000 7f75c2a00640 1 -- 172.21.15.2:0/1011792170 >> v1:172.21.15.2:6789/0 conn(0x7f75c40cece0 legacy=0x7f75c4072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.490+0000 7f75c2a00640 1 -- 172.21.15.2:0/1011792170 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c4161f90 con 0x7f75c415bb40 2024-05-14T15:17:00.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.491+0000 7f75c2a00640 1 --2- 172.21.15.2:0/1011792170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c415bb40 0x7f75c40ce7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75c4162760 tx=0x7f75b402a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc876eb60cd0954e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:00.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.491+0000 7f75c1600640 1 -- 172.21.15.2:0/1011792170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4037070 con 0x7f75c415bb40 2024-05-14T15:17:00.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c1600640 1 -- 172.21.15.2:0/1011792170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b402ae40 con 0x7f75c415bb40 2024-05-14T15:17:00.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c1600640 1 -- 172.21.15.2:0/1011792170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4032660 con 0x7f75c415bb40 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 -- 172.21.15.2:0/1011792170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c415bb40 msgr2=0x7f75c40ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 --2- 172.21.15.2:0/1011792170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c415bb40 0x7f75c40ce7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75c4162760 tx=0x7f75b402a0f0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 -- 172.21.15.2:0/1011792170 shutdown_connections 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 --2- 172.21.15.2:0/1011792170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c415bb40 0x7f75c40ce7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 -- 172.21.15.2:0/1011792170 >> 172.21.15.2:0/1011792170 conn(0x7f75c40d3760 msgr2=0x7f75c40d3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 -- 172.21.15.2:0/1011792170 shutdown_connections 2024-05-14T15:17:00.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.492+0000 7f75c3e00640 1 -- 172.21.15.2:0/1011792170 wait complete. 2024-05-14T15:17:00.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.495+0000 7f75c3e00640 1 Processor -- start 2024-05-14T15:17:00.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.495+0000 7f75c3e00640 1 -- start start 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.496+0000 7f75c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 0x7f75c4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.496+0000 7f75c3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c40c7290 0x7f75c4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.496+0000 7f75c3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75c41598c0 0x7f75c415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.496+0000 7f75c3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75c415f200 con 0x7f75c40cece0 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.496+0000 7f75c3e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f75c415f080 con 0x7f75c40c7290 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.496+0000 7f75c3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f75c40d2d00 con 0x7f75c41598c0 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 0x7f75c4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 0x7f75c4151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56656/0 (socket says 172.21.15.2:56656) 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 -- 172.21.15.2:0/206268368 learned_addr learned my addr 172.21.15.2:0/206268368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2000640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c40c7290 0x7f75c4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 -- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75c41598c0 msgr2=0x7f75c415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75c41598c0 0x7f75c415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 -- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c40c7290 msgr2=0x7f75c4159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c40c7290 0x7f75c4159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.497+0000 7f75c2a00640 1 -- 172.21.15.2:0/206268368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c4159cd0 con 0x7f75c40cece0 2024-05-14T15:17:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.498+0000 7f75c2a00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 0x7f75c4151ef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f75b4000c00 tx=0x7f75b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.498+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4042070 con 0x7f75c40cece0 2024-05-14T15:17:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.498+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b403e670 con 0x7f75c40cece0 2024-05-14T15:17:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.498+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4037040 con 0x7f75c40cece0 2024-05-14T15:17:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.498+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c40c7c70 con 0x7f75c40cece0 2024-05-14T15:17:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.498+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c40c8230 con 0x7f75c40cece0 2024-05-14T15:17:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.499+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c415eca0 con 0x7f75c40cece0 2024-05-14T15:17:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.501+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75b4045070 con 0x7f75c40cece0 2024-05-14T15:17:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.501+0000 7f75baa00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f75a4076300 0x7f75a4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.502+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f75b40b7e00 con 0x7f75c40cece0 2024-05-14T15:17:00.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.502+0000 7f75c2000640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f75a4076300 0x7f75a4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.504+0000 7f75c2000640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f75a4076300 0x7f75a4078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75b0007fd0 tx=0x7f75b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.506+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75b40817f0 con 0x7f75c40cece0 2024-05-14T15:17:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.795+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f75c4050870 con 0x7f75c40cece0 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.796+0000 7f75baa00640 1 -- 172.21.15.2:0/206268368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f75b40810f0 con 0x7f75c40cece0 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDkf0NmwsIGBxAACSRDI/TCHGBTUp7BU0Auqg==", 2024-05-14T15:17:00.795 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDkf0NmMvqLMBAAb9uVsfX9n0vehJo5rK7aUQ==", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.796 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDkf0NmTFwOHBAAveqJ5HneY8OU1abFzPgzkA==", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDlf0NmlLSbBxAAiA3prVybb/j0H+SyIkx3bw==", 2024-05-14T15:17:00.797 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDnf0NmwOv4MBAADORgfjI361wlZ2cmhd3P0Q==", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.798 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDrf0Nm9UqcFBAAdi01CxUgzIG8EEhCGwkR6w==", 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDuf0NmDhx0NBAA3O/zS6AYEgmEtRfUIbGHkw==", 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.799 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDyf0NmgR1eFxAAufolFP+dt5Iupdo/yBAEkw==", 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.800 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQD3f0NmmUCaEBAA78MK+Fzhx04IZRGlngxodA==", 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQD6f0NmM/DrHxAAZEpFcpm1YsxwGPT9YapkVg==", 2024-05-14T15:17:00.801 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQD9f0Nmk46FNBAA3eORaBBE+EumAV7jRhsZIA==", 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.802 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQABgENm3CWtFhAAGTvxsI7lbhkSKHYgQrvTKg==", 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDlf0NmBstLGRAAlDPeAYruInsfHUZyxMEQcw==", 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDlf0NmzuBtNxAAO9fEl7wrxDNDvikPqtgbcw==", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-05-14T15:17:00.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDlf0NmSq6XKBAAQjuH3s0WePNYbsSZv0SJeA==", 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2024-05-14T15:17:00.805 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDmf0NmW815CRAAlY6vJVNgyzFR44pOq2n85Q==", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDif0NmgjmcLRAAthHg72B40cjBW9UMyAsd2A==", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-05-14T15:17:00.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALgENmlsPdIBAAkzOD7pquJ8E4ZDdN8W37SQ==", 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALgENmFs7dIBAAfAw8W6EZpGGjp1OTbn+6sA==", 2024-05-14T15:17:00.807 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALgENmXtfdIBAAkCNIGl9xMSOiWn8uxiBYiQ==", 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALgENm/N/dIBAAHNGla6AV+0JjnUx38bqRYQ==", 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALgENm4+jdIBAADZ7mNsmJa3tgUHzOBKysLg==", 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALgENmFPLdIBAARVTBSIGY56cVsRYKRlmUhw==", 2024-05-14T15:17:00.809 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDjf0Nm+weTMhAAla83rkqxMJPCvvsKLep/Jw==", 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2024-05-14T15:17:00.810 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDjf0NmfDZBIhAAa566CCFYYbV/06hDcLW6hQ==", 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-05-14T15:17:00.811 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:17:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f75a4076300 msgr2=0x7f75a4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f75a4076300 0x7f75a4078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75b0007fd0 tx=0x7f75b0009040 comp rx=0 tx=0).stop 2024-05-14T15:17:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 msgr2=0x7f75c4151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 0x7f75c4151ef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f75b4000c00 tx=0x7f75b40046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 shutdown_connections 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f75a4076300 0x7f75a4078810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c40c7290 0x7f75c4159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75c41598c0 0x7f75c415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 --2- 172.21.15.2:0/206268368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75c40cece0 0x7f75c4151ef0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.799+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 >> 172.21.15.2:0/206268368 conn(0x7f75c40d3760 msgr2=0x7f75c40b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.800+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 shutdown_connections 2024-05-14T15:17:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:00.800+0000 7f75c3e00640 1 -- 172.21.15.2:0/206268368 wait complete. 2024-05-14T15:17:00.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-14T15:17:01.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.109+0000 7fde0be00640 1 Processor -- start 2024-05-14T15:17:01.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.109+0000 7fde0be00640 1 -- start start 2024-05-14T15:17:01.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.111+0000 7fde0be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c149290 0x7fde0c0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.111+0000 7fde0be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde0c0b08f0 0x7fde0c146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.111+0000 7fde0be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0c070b70 con 0x7fde0c070760 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.111+0000 7fde0be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c0aeda0 con 0x7fde0c0b08f0 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.111+0000 7fde0be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c0aeac0 con 0x7fde0c149290 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde0c0b08f0 0x7fde0c146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde0c0b08f0 0x7fde0c146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56672/0 (socket says 172.21.15.2:56672) 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 -- 172.21.15.2:0/4090004068 learned_addr learned my addr 172.21.15.2:0/4090004068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0a000640 1 --1- 172.21.15.2:0/4090004068 >> v1:172.21.15.2:6789/0 conn(0x7fde0c070760 0x7fde0c0b01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33598/0 (socket says 172.21.15.2:33598) 2024-05-14T15:17:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0aa00640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c149290 0x7fde0c0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 -- 172.21.15.2:0/4090004068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c149290 msgr2=0x7fde0c0b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c149290 0x7fde0c0b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 -- 172.21.15.2:0/4090004068 >> v1:172.21.15.2:6789/0 conn(0x7fde0c070760 legacy=0x7fde0c0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0b400640 1 -- 172.21.15.2:0/4090004068 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c06fc80 con 0x7fde0c0b08f0 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde0aa00640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c149290 0x7fde0c0b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.112+0000 7fde09600640 1 -- 172.21.15.2:0/4090004068 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017536694 0 0) 0x7fde0c070b70 con 0x7fde0c070760 2024-05-14T15:17:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.113+0000 7fde0b400640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c0b08f0 0x7fde0c146270 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fde04009870 tx=0x7fde0402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f90431e9243559 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.114+0000 7fde09600640 1 -- 172.21.15.2:0/4090004068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04037070 con 0x7fde0c0b08f0 2024-05-14T15:17:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.114+0000 7fde09600640 1 -- 172.21.15.2:0/4090004068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde04032440 con 0x7fde0c0b08f0 2024-05-14T15:17:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.114+0000 7fde09600640 1 -- 172.21.15.2:0/4090004068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04032810 con 0x7fde0c0b08f0 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.114+0000 7fde0be00640 1 -- 172.21.15.2:0/4090004068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c0b08f0 msgr2=0x7fde0c146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.114+0000 7fde0be00640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c0b08f0 0x7fde0c146270 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fde04009870 tx=0x7fde0402a250 comp rx=0 tx=0).stop 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.115+0000 7fde0be00640 1 -- 172.21.15.2:0/4090004068 shutdown_connections 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.115+0000 7fde0be00640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c0b08f0 0x7fde0c146270 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.115+0000 7fde0be00640 1 --2- 172.21.15.2:0/4090004068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c149290 0x7fde0c0b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.115+0000 7fde0be00640 1 -- 172.21.15.2:0/4090004068 >> 172.21.15.2:0/4090004068 conn(0x7fde0c0739a0 msgr2=0x7fde0c073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.115+0000 7fde0be00640 1 -- 172.21.15.2:0/4090004068 shutdown_connections 2024-05-14T15:17:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.115+0000 7fde0be00640 1 -- 172.21.15.2:0/4090004068 wait complete. 2024-05-14T15:17:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.117+0000 7fde0be00640 1 Processor -- start 2024-05-14T15:17:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.117+0000 7fde0be00640 1 -- start start 2024-05-14T15:17:01.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde0c070760 0x7fde0c15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c0b08f0 0x7fde0c1f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 0x7fde0c1fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c0ae750 con 0x7fde0c149290 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c070240 con 0x7fde0c070760 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c0b4c80 con 0x7fde0c0b08f0 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 0x7fde0c1fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 0x7fde0c1fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56678/0 (socket says 172.21.15.2:56678) 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0b400640 1 -- 172.21.15.2:0/3297018788 learned_addr learned my addr 172.21.15.2:0/3297018788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0aa00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde0c070760 0x7fde0c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.119+0000 7fde0a000640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c0b08f0 0x7fde0c1f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0b400640 1 -- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c0b08f0 msgr2=0x7fde0c1f9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0b400640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c0b08f0 0x7fde0c1f9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0b400640 1 -- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde0c070760 msgr2=0x7fde0c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0b400640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde0c070760 0x7fde0c15f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0b400640 1 -- 172.21.15.2:0/3297018788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c1faa10 con 0x7fde0c149290 2024-05-14T15:17:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0aa00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde0c070760 0x7fde0c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0b400640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 0x7fde0c1fa1d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fde04009870 tx=0x7fde040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04037040 con 0x7fde0c149290 2024-05-14T15:17:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde04004230 con 0x7fde0c149290 2024-05-14T15:17:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04003610 con 0x7fde0c149290 2024-05-14T15:17:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.120+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c1f6920 con 0x7fde0c149290 2024-05-14T15:17:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.121+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c1f6610 con 0x7fde0c149290 2024-05-14T15:17:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.122+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c1fa780 con 0x7fde0c149290 2024-05-14T15:17:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.123+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde040037b0 con 0x7fde0c149290 2024-05-14T15:17:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.125+0000 7fde02a00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fddec0762d0 0x7fddec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.125+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fde040b8260 con 0x7fde0c149290 2024-05-14T15:17:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.125+0000 7fde0aa00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fddec0762d0 0x7fddec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.127+0000 7fde0aa00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fddec0762d0 0x7fddec0787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fddfc006fd0 tx=0x7fddfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.130+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde04045e50 con 0x7fde0c149290 2024-05-14T15:17:01.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.421+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fde0c06de50 con 0x7fde0c149290 2024-05-14T15:17:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.426+0000 7fde02a00640 1 -- 172.21.15.2:0/3297018788 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fde04081ce0 con 0x7fde0c149290 2024-05-14T15:17:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.428+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fddec0762d0 msgr2=0x7fddec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.428+0000 7fde0be00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fddec0762d0 0x7fddec0787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fddfc006fd0 tx=0x7fddfc008040 comp rx=0 tx=0).stop 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.428+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 msgr2=0x7fde0c1fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.428+0000 7fde0be00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 0x7fde0c1fa1d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fde04009870 tx=0x7fde040046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 shutdown_connections 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fddec0762d0 0x7fddec0787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde0c149290 0x7fde0c1fa1d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde0c0b08f0 0x7fde0c1f9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 --2- 172.21.15.2:0/3297018788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde0c070760 0x7fde0c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 >> 172.21.15.2:0/3297018788 conn(0x7fde0c0739a0 msgr2=0x7fde0c0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 shutdown_connections 2024-05-14T15:17:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.429+0000 7fde0be00640 1 -- 172.21.15.2:0/3297018788 wait complete. 2024-05-14T15:17:01.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-14T15:17:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.724+0000 7f797ce00640 1 Processor -- start 2024-05-14T15:17:01.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.724+0000 7f797ce00640 1 -- start start 2024-05-14T15:17:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.726+0000 7f797ce00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79780af630 0x7f7978161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.726+0000 7f797ce00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f797815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.726+0000 7f797ce00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7978162150 con 0x7f797815e750 2024-05-14T15:17:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.726+0000 7f797ce00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f79780b0f70 con 0x7f79780af630 2024-05-14T15:17:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.726+0000 7f797ce00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f79780b0360 con 0x7f7978161d40 2024-05-14T15:17:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79780af630 0x7f7978161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79780af630 0x7f7978161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56686/0 (socket says 172.21.15.2:56686) 2024-05-14T15:17:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 -- 172.21.15.2:0/2960485177 learned_addr learned my addr 172.21.15.2:0/2960485177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f796ea00640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f797815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 -- 172.21.15.2:0/2960485177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 msgr2=0x7f797815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f797815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 -- 172.21.15.2:0/2960485177 >> v1:172.21.15.156:6789/0 conn(0x7f797815e750 legacy=0x7f797815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f7977400640 1 -- 172.21.15.2:0/2960485177 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79780b0640 con 0x7f79780af630 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.727+0000 7f796ea00640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f797815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.729+0000 7f7977400640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f7978161800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7968009870 tx=0x7f796802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e503a0e18e63a2bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.729+0000 7f7976a00640 1 -- 172.21.15.2:0/2960485177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968037070 con 0x7f79780af630 2024-05-14T15:17:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.729+0000 7f7976a00640 1 -- 172.21.15.2:0/2960485177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7968032440 con 0x7f79780af630 2024-05-14T15:17:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.729+0000 7f7976a00640 1 -- 172.21.15.2:0/2960485177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968032810 con 0x7f79780af630 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 -- 172.21.15.2:0/2960485177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 msgr2=0x7f7978161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f7978161800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7968009870 tx=0x7f796802a130 comp rx=0 tx=0).stop 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 -- 172.21.15.2:0/2960485177 shutdown_connections 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f797815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 --2- 172.21.15.2:0/2960485177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f7978161800 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 -- 172.21.15.2:0/2960485177 >> 172.21.15.2:0/2960485177 conn(0x7f79780739a0 msgr2=0x7f7978073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 -- 172.21.15.2:0/2960485177 shutdown_connections 2024-05-14T15:17:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.730+0000 7f797ce00640 1 -- 172.21.15.2:0/2960485177 wait complete. 2024-05-14T15:17:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.733+0000 7f797ce00640 1 Processor -- start 2024-05-14T15:17:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.733+0000 7f797ce00640 1 -- start start 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f797ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f79781ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f797ce00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f797815e750 0x7f797814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f797ce00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f79781e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f797ce00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7978162560 con 0x7f79780af630 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f797ce00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f79780b0c00 con 0x7f797815e750 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f797ce00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f79780afa40 con 0x7f7978161d40 2024-05-14T15:17:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.734+0000 7f7977400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f79781ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f79781ea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56700/0 (socket says 172.21.15.2:56700) 2024-05-14T15:17:01.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 -- 172.21.15.2:0/3241614391 learned_addr learned my addr 172.21.15.2:0/3241614391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f796ea00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f797815e750 0x7f797814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 -- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 msgr2=0x7f79781e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977e00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f79781e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f79781e9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 -- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f797815e750 msgr2=0x7f797814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f797815e750 0x7f797814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 -- 172.21.15.2:0/3241614391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79780b4980 con 0x7f79780af630 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f796ea00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f797815e750 0x7f797814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977e00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f79781e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.735+0000 7f7977400640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f79781ea850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7968000c00 tx=0x7f79680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.736+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968041070 con 0x7f79780af630 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.736+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796803c870 con 0x7f79780af630 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.736+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968037040 con 0x7f79780af630 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.736+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79780b4c60 con 0x7f79780af630 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.736+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79780b5220 con 0x7f79780af630 2024-05-14T15:17:01.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.737+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978050870 con 0x7f79780af630 2024-05-14T15:17:01.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.738+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7968044070 con 0x7f79780af630 2024-05-14T15:17:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.740+0000 7f796fe00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7954076300 0x7f7954078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:01.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.740+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f79680b8130 con 0x7f79780af630 2024-05-14T15:17:01.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.741+0000 7f796ea00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7954076300 0x7f7954078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:01.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.742+0000 7f796ea00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7954076300 0x7f7954078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7960006fd0 tx=0x7f7960008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:01.745+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7978162150 con 0x7f79780af630 2024-05-14T15:17:02.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.039+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f7978160260 con 0x7f79780af630 2024-05-14T15:17:02.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.043+0000 7f796fe00640 1 -- 172.21.15.2:0/3241614391 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f7968081b20 con 0x7f79780af630 2024-05-14T15:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7954076300 msgr2=0x7f7954078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7954076300 0x7f7954078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7960006fd0 tx=0x7f7960008040 comp rx=0 tx=0).stop 2024-05-14T15:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 msgr2=0x7f79781ea850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f79781ea850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7968000c00 tx=0x7f79680046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 shutdown_connections 2024-05-14T15:17:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7954076300 0x7f7954078810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f797815e750 0x7f797814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7978161d40 0x7f79781e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 --2- 172.21.15.2:0/3241614391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79780af630 0x7f79781ea850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 >> 172.21.15.2:0/3241614391 conn(0x7f79780739a0 msgr2=0x7f797815fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 shutdown_connections 2024-05-14T15:17:02.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.046+0000 7f797ce00640 1 -- 172.21.15.2:0/3241614391 wait complete. 2024-05-14T15:17:02.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-14T15:17:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.363+0000 7f4ec3e00640 1 Processor -- start 2024-05-14T15:17:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.363+0000 7f4ec3e00640 1 -- start start 2024-05-14T15:17:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.365+0000 7f4ec3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4161f10 0x7f4ec40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.365+0000 7f4ec3e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec40b0360 con 0x7f4ec40cfc70 2024-05-14T15:17:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.365+0000 7f4ec3e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec40b0640 con 0x7f4ec40af630 2024-05-14T15:17:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.365+0000 7f4ec3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec40b0f70 con 0x7f4ec4161f10 2024-05-14T15:17:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.366+0000 7f4ec3400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4ec40cfc70 0x7f4ec40d0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33600/0 (socket says 172.21.15.2:33600) 2024-05-14T15:17:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.366+0000 7f4ec3400640 1 -- 172.21.15.2:0/2538513689 learned_addr learned my addr 172.21.15.2:0/2538513689 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.366+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229171238 0 0) 0x7f4ec40b0360 con 0x7f4ec40cfc70 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.366+0000 7f4ec2000640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4161f10 0x7f4ec40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.366+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea8003520 con 0x7f4ec40cfc70 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3461987247 0 0) 0x7f4ea8003520 con 0x7f4ec40cfc70 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4161f10 msgr2=0x7f4ec40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4161f10 0x7f4ec40cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 >> v1:172.21.15.156:6789/0 conn(0x7f4ec40af630 legacy=0x7f4ec4161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec40b0920 con 0x7f4ec40cfc70 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f4ebc001a70 con 0x7f4ec40cfc70 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 >> v1:172.21.15.2:6789/0 conn(0x7f4ec40cfc70 legacy=0x7f4ec40d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ea8003a80 0x7f4ea8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ea8005270 0x7f4ea800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec40b0f70 con 0x7f4ea8005270 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea800c090 con 0x7f4ea8003a80 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea800c290 con 0x7f4ea8004800 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.367+0000 7f4ec3400640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ea8005270 0x7f4ea800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec2a00640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ea8003a80 0x7f4ea8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec2000640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec3400640 1 -- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8004800 msgr2=0x7f4ea8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec3400640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec3400640 1 -- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ea8003a80 msgr2=0x7f4ea8003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec3400640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ea8003a80 0x7f4ea8003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec3400640 1 -- 172.21.15.2:0/2538513689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea8003520 con 0x7f4ea8005270 2024-05-14T15:17:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.368+0000 7f4ec2000640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8004800 0x7f4ea8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.369+0000 7f4ec3400640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ea8005270 0x7f4ea800b9c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b6a10 tx=0x7f4ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610ece7ea1f417de server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.369+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00a450 con 0x7f4ea8005270 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.369+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ebc02f070 con 0x7f4ea8005270 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.369+0000 7f4ec1600640 1 -- 172.21.15.2:0/2538513689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc02bb50 con 0x7f4ea8005270 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2538513689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ea8005270 msgr2=0x7f4ea800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2538513689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ea8005270 0x7f4ea800b9c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b6a10 tx=0x7f4ea8005830 comp rx=0 tx=0).stop 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3400640 1 -- 172.21.15.2:0/2538513689 reap_dead start 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2538513689 shutdown_connections 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2538513689 >> 172.21.15.2:0/2538513689 conn(0x7f4ec40739a0 msgr2=0x7f4ec4073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2538513689 shutdown_connections 2024-05-14T15:17:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.370+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2538513689 wait complete. 2024-05-14T15:17:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.372+0000 7f4ec3e00640 1 Processor -- start 2024-05-14T15:17:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.373+0000 7f4ec3e00640 1 -- start start 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec3e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8005270 0x7f4ec4143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 0x7f4ec409e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec4157960 0x7f4ec409ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec40afa40 con 0x7f4ec4157550 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec3e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4162560 con 0x7f4ec4157960 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec3e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec40afbc0 con 0x7f4ea8005270 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 0x7f4ec409e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 0x7f4ec409e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56718/0 (socket says 172.21.15.2:56718) 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.374+0000 7f4ec2000640 1 -- 172.21.15.2:0/2780718308 learned_addr learned my addr 172.21.15.2:0/2780718308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2a00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8005270 0x7f4ec4143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec3400640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec4157960 0x7f4ec409ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2000640 1 -- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8005270 msgr2=0x7f4ec4143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2000640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8005270 0x7f4ec4143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2000640 1 -- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec4157960 msgr2=0x7f4ec409ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2000640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec4157960 0x7f4ec409ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2000640 1 -- 172.21.15.2:0/2780718308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec41f3fc0 con 0x7f4ec4157550 2024-05-14T15:17:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ec2000640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 0x7f4ec409e930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000e840 tx=0x7f4eb000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0017070 con 0x7f4ec4157550 2024-05-14T15:17:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb000c6d0 con 0x7f4ec4157550 2024-05-14T15:17:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.375+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb000f040 con 0x7f4ec4157550 2024-05-14T15:17:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.376+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec4144250 con 0x7f4ec4157550 2024-05-14T15:17:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.376+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec409b890 con 0x7f4ec4157550 2024-05-14T15:17:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.377+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec4157ed0 con 0x7f4ec4157550 2024-05-14T15:17:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.378+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4eb001a070 con 0x7f4ec4157550 2024-05-14T15:17:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.379+0000 7f4ebaa00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ea40762d0 0x7f4ea40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.379+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f4eb0096ff0 con 0x7f4ec4157550 2024-05-14T15:17:02.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.380+0000 7f4ec2a00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ea40762d0 0x7f4ea40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.381+0000 7f4ec2a00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ea40762d0 0x7f4ea40787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40055b0 tx=0x7f4eb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.384+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4eb0060b10 con 0x7f4ec4157550 2024-05-14T15:17:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.679+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f4ec4050870 con 0x7f4ec4157550 2024-05-14T15:17:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.686+0000 7f4ebaa00640 1 -- 172.21.15.2:0/2780718308 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f4eb0060410 con 0x7f4ec4157550 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ea40762d0 msgr2=0x7f4ea40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ea40762d0 0x7f4ea40787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40055b0 tx=0x7f4eb4009040 comp rx=0 tx=0).stop 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 msgr2=0x7f4ec409e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 0x7f4ec409e930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000e840 tx=0x7f4eb000ed00 comp rx=0 tx=0).stop 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 shutdown_connections 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ea40762d0 0x7f4ea40787e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec4157960 0x7f4ec409ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ec4157550 0x7f4ec409e930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 --2- 172.21.15.2:0/2780718308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ea8005270 0x7f4ec4143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 >> 172.21.15.2:0/2780718308 conn(0x7f4ec40739a0 msgr2=0x7f4ec415e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 shutdown_connections 2024-05-14T15:17:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.689+0000 7f4ec3e00640 1 -- 172.21.15.2:0/2780718308 wait complete. 2024-05-14T15:17:02.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-14T15:17:02.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.996+0000 7f1796e00640 1 Processor -- start 2024-05-14T15:17:02.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.996+0000 7f1796e00640 1 -- start start 2024-05-14T15:17:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1796e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1790160720 0x7f17900b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1796e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17900cdd80 0x7f17900b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1796e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1790160c90 con 0x7f17900b4bb0 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1796e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f179015ab00 con 0x7f17900cdd80 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1796e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f1790160f70 con 0x7f1790160720 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1795000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17900cdd80 0x7f17900b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1795000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17900cdd80 0x7f17900b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56720/0 (socket says 172.21.15.2:56720) 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:02.999+0000 7f1795000640 1 -- 172.21.15.2:0/603188082 learned_addr learned my addr 172.21.15.2:0/603188082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.000+0000 7f1795a00640 1 --2- 172.21.15.2:0/603188082 >> v2:172.21.15.156:3300/0 conn(0x7f1790160720 0x7f17900b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.000+0000 7f1795000640 1 -- 172.21.15.2:0/603188082 >> v2:172.21.15.156:3300/0 conn(0x7f1790160720 msgr2=0x7f17900b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.000+0000 7f1795000640 1 --2- 172.21.15.2:0/603188082 >> v2:172.21.15.156:3300/0 conn(0x7f1790160720 0x7f17900b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.000+0000 7f1795000640 1 -- 172.21.15.2:0/603188082 >> v1:172.21.15.156:6789/0 conn(0x7f17900b4bb0 legacy=0x7f179015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.000+0000 7f1795000640 1 -- 172.21.15.2:0/603188082 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790161250 con 0x7f17900cdd80 2024-05-14T15:17:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.001+0000 7f1795000640 1 --2- 172.21.15.2:0/603188082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b4670 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17900722a0 tx=0x7f177c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70da5229d728fa25 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.001+0000 7f178fe00640 1 -- 172.21.15.2:0/603188082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c037070 con 0x7f17900cdd80 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f178fe00640 1 -- 172.21.15.2:0/603188082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c032440 con 0x7f17900cdd80 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f178fe00640 1 -- 172.21.15.2:0/603188082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c032810 con 0x7f17900cdd80 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f1796e00640 1 -- 172.21.15.2:0/603188082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 msgr2=0x7f17900b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f1796e00640 1 --2- 172.21.15.2:0/603188082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b4670 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17900722a0 tx=0x7f177c02a1e0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f1796e00640 1 -- 172.21.15.2:0/603188082 shutdown_connections 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f1796e00640 1 --2- 172.21.15.2:0/603188082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b4670 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f1796e00640 1 --2- 172.21.15.2:0/603188082 >> v2:172.21.15.156:3300/0 conn(0x7f1790160720 0x7f17900b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.002+0000 7f1796e00640 1 -- 172.21.15.2:0/603188082 >> 172.21.15.2:0/603188082 conn(0x7f17900739a0 msgr2=0x7f1790073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.003+0000 7f1796e00640 1 -- 172.21.15.2:0/603188082 shutdown_connections 2024-05-14T15:17:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.003+0000 7f1796e00640 1 -- 172.21.15.2:0/603188082 wait complete. 2024-05-14T15:17:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.005+0000 7f1796e00640 1 Processor -- start 2024-05-14T15:17:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.005+0000 7f1796e00640 1 -- start start 2024-05-14T15:17:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1796e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17900b4bb0 0x7f1790151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1796e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1796e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1790160720 0x7f17900b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1796e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17900b6a70 con 0x7f17900cdd80 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1796e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1790161530 con 0x7f1790160720 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1796e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f179015de70 con 0x7f17900b4bb0 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1795000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1795000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56732/0 (socket says 172.21.15.2:56732) 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.007+0000 7f1795000640 1 -- 172.21.15.2:0/2621959286 learned_addr learned my addr 172.21.15.2:0/2621959286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795a00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17900b4bb0 0x7f1790151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1796400640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1790160720 0x7f17900b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795000640 1 -- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17900b4bb0 msgr2=0x7f1790151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795000640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17900b4bb0 0x7f1790151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795000640 1 -- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1790160720 msgr2=0x7f17900b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795000640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1790160720 0x7f17900b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795000640 1 -- 172.21.15.2:0/2621959286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790153c90 con 0x7f17900cdd80 2024-05-14T15:17:03.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.008+0000 7f1795000640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f177c02a220 tx=0x7f177c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.009+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c041020 con 0x7f17900cdd80 2024-05-14T15:17:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.009+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0306c0 con 0x7f17900cdd80 2024-05-14T15:17:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.009+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c037040 con 0x7f17900cdd80 2024-05-14T15:17:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.009+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1790153f70 con 0x7f17900cdd80 2024-05-14T15:17:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.009+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1790154530 con 0x7f17900cdd80 2024-05-14T15:17:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.010+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1790050870 con 0x7f17900cdd80 2024-05-14T15:17:03.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.012+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f177c044020 con 0x7f17900cdd80 2024-05-14T15:17:03.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.013+0000 7f178d600640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17700762d0 0x7f17700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.013+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f177c0b7e00 con 0x7f17900cdd80 2024-05-14T15:17:03.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.014+0000 7f1795a00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17700762d0 0x7f17700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.016+0000 7f1795a00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17700762d0 0x7f17700787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1784006fd0 tx=0x7f1784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.018+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f177c04b030 con 0x7f17900cdd80 2024-05-14T15:17:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.302+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f1790074250 con 0x7f17900cdd80 2024-05-14T15:17:03.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.307+0000 7f178d600640 1 -- 172.21.15.2:0/2621959286 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f177c0817f0 con 0x7f17900cdd80 2024-05-14T15:17:03.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17700762d0 msgr2=0x7f17700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17700762d0 0x7f17700787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1784006fd0 tx=0x7f1784008040 comp rx=0 tx=0).stop 2024-05-14T15:17:03.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 msgr2=0x7f17900b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f177c02a220 tx=0x7f177c0046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 shutdown_connections 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f17700762d0 0x7f17700787e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1790160720 0x7f17900b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17900cdd80 0x7f17900b50c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 --2- 172.21.15.2:0/2621959286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17900b4bb0 0x7f1790151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.309+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 >> 172.21.15.2:0/2621959286 conn(0x7f17900739a0 msgr2=0x7f179006f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.310+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 shutdown_connections 2024-05-14T15:17:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.310+0000 7f1796e00640 1 -- 172.21.15.2:0/2621959286 wait complete. 2024-05-14T15:17:03.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-14T15:17:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.618+0000 7f1b6b200640 1 Processor -- start 2024-05-14T15:17:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.618+0000 7f1b6b200640 1 -- start start 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b6b200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b6c0af630 0x7f1b6c161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b6b200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b6c161d40 0x7f1b6c15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b6b200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c15e750 0x7f1b6c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b6b200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6c0b0f70 con 0x7f1b6c161d40 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b6b200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6c162150 con 0x7f1b6c0af630 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b6b200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6c15f0a0 con 0x7f1b6c15e750 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b61400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b6c161d40 0x7f1b6c15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b61400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b6c161d40 0x7f1b6c15e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56742/0 (socket says 172.21.15.2:56742) 2024-05-14T15:17:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b61400640 1 -- 172.21.15.2:0/452986834 learned_addr learned my addr 172.21.15.2:0/452986834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b69e00640 1 --2- 172.21.15.2:0/452986834 >> v2:172.21.15.156:3300/0 conn(0x7f1b6c0af630 0x7f1b6c161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.620+0000 7f1b61400640 1 -- 172.21.15.2:0/452986834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c15e750 msgr2=0x7f1b6c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.621+0000 7f1b61400640 1 --2- 172.21.15.2:0/452986834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c15e750 0x7f1b6c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.621+0000 7f1b61400640 1 -- 172.21.15.2:0/452986834 >> v2:172.21.15.156:3300/0 conn(0x7f1b6c0af630 msgr2=0x7f1b6c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.621+0000 7f1b61400640 1 --2- 172.21.15.2:0/452986834 >> v2:172.21.15.156:3300/0 conn(0x7f1b6c0af630 0x7f1b6c161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.621+0000 7f1b61400640 1 -- 172.21.15.2:0/452986834 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c0b0360 con 0x7f1b6c161d40 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.621+0000 7f1b69e00640 1 --2- 172.21.15.2:0/452986834 >> v2:172.21.15.156:3300/0 conn(0x7f1b6c0af630 0x7f1b6c161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.622+0000 7f1b61400640 1 --2- 172.21.15.2:0/452986834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c161d40 0x7f1b6c15e210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c072e20 tx=0x7f1b5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd9864b069a881b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:03.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.622+0000 7f1b69400640 1 -- 172.21.15.2:0/452986834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54037070 con 0x7f1b6c161d40 2024-05-14T15:17:03.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.622+0000 7f1b69400640 1 -- 172.21.15.2:0/452986834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54032440 con 0x7f1b6c161d40 2024-05-14T15:17:03.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.622+0000 7f1b69400640 1 -- 172.21.15.2:0/452986834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54032810 con 0x7f1b6c161d40 2024-05-14T15:17:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 -- 172.21.15.2:0/452986834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c161d40 msgr2=0x7f1b6c15e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 --2- 172.21.15.2:0/452986834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c161d40 0x7f1b6c15e210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c072e20 tx=0x7f1b5402a1e0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 -- 172.21.15.2:0/452986834 shutdown_connections 2024-05-14T15:17:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 --2- 172.21.15.2:0/452986834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c15e750 0x7f1b6c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 --2- 172.21.15.2:0/452986834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c161d40 0x7f1b6c15e210 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 --2- 172.21.15.2:0/452986834 >> v2:172.21.15.156:3300/0 conn(0x7f1b6c0af630 0x7f1b6c161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 -- 172.21.15.2:0/452986834 >> 172.21.15.2:0/452986834 conn(0x7f1b6c0739a0 msgr2=0x7f1b6c073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 -- 172.21.15.2:0/452986834 shutdown_connections 2024-05-14T15:17:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.623+0000 7f1b6b200640 1 -- 172.21.15.2:0/452986834 wait complete. 2024-05-14T15:17:03.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.625+0000 7f1b6b200640 1 Processor -- start 2024-05-14T15:17:03.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.626+0000 7f1b6b200640 1 -- start start 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b6b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6c0af630 0x7f1b6c146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b6b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 0x7f1b6c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b6b200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c161d40 0x7f1b6c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b6b200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c0b0c00 con 0x7f1b6c15e750 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b6b200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c0b0920 con 0x7f1b6c0af630 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b6b200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6c162560 con 0x7f1b6c161d40 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b61400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 0x7f1b6c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b61400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 0x7f1b6c0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56748/0 (socket says 172.21.15.2:56748) 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.627+0000 7f1b61400640 1 -- 172.21.15.2:0/2407428175 learned_addr learned my addr 172.21.15.2:0/2407428175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b61400640 1 -- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c161d40 msgr2=0x7f1b6c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b69e00640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6c0af630 0x7f1b6c146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b6a800640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c161d40 0x7f1b6c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b61400640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c161d40 0x7f1b6c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b61400640 1 -- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6c0af630 msgr2=0x7f1b6c146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b61400640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6c0af630 0x7f1b6c146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b61400640 1 -- 172.21.15.2:0/2407428175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c1e76e0 con 0x7f1b6c15e750 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b6a800640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c161d40 0x7f1b6c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:03.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.628+0000 7f1b61400640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 0x7f1b6c0b4770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1b5402a220 tx=0x7f1b540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.629+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54037040 con 0x7f1b6c15e750 2024-05-14T15:17:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.629+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c0b6260 con 0x7f1b6c15e750 2024-05-14T15:17:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.629+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54042070 con 0x7f1b6c15e750 2024-05-14T15:17:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.629+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54030b90 con 0x7f1b6c15e750 2024-05-14T15:17:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.629+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c0b55c0 con 0x7f1b6c15e750 2024-05-14T15:17:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.630+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6c0b5030 con 0x7f1b6c15e750 2024-05-14T15:17:03.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.631+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b54047460 con 0x7f1b6c15e750 2024-05-14T15:17:03.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.632+0000 7f1b62a00640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1b48076300 0x7f1b48078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:03.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.632+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f1b540b8150 con 0x7f1b6c15e750 2024-05-14T15:17:03.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.633+0000 7f1b69e00640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1b48076300 0x7f1b48078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:03.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.634+0000 7f1b69e00640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1b48076300 0x7f1b48078810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b840 tx=0x7f1b5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.637+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b54081bd0 con 0x7f1b6c15e750 2024-05-14T15:17:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.918+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f1b6c050870 con 0x7f1b6c15e750 2024-05-14T15:17:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.924+0000 7f1b62a00640 1 -- 172.21.15.2:0/2407428175 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f1b540814d0 con 0x7f1b6c15e750 2024-05-14T15:17:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1b48076300 msgr2=0x7f1b48078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1b48076300 0x7f1b48078810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b840 tx=0x7f1b5c008040 comp rx=0 tx=0).stop 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 msgr2=0x7f1b6c0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 0x7f1b6c0b4770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1b5402a220 tx=0x7f1b540046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 shutdown_connections 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1b48076300 0x7f1b48078810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6c161d40 0x7f1b6c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b6c15e750 0x7f1b6c0b4770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 --2- 172.21.15.2:0/2407428175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6c0af630 0x7f1b6c146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.926+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 >> 172.21.15.2:0/2407428175 conn(0x7f1b6c0739a0 msgr2=0x7f1b6c0afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.927+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 shutdown_connections 2024-05-14T15:17:03.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:03.927+0000 7f1b6b200640 1 -- 172.21.15.2:0/2407428175 wait complete. 2024-05-14T15:17:03.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-14T15:17:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.233+0000 7f4732400640 1 Processor -- start 2024-05-14T15:17:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.233+0000 7f4732400640 1 -- start start 2024-05-14T15:17:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.236+0000 7f4732400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 0x7f472c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.236+0000 7f4732400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f472c0cfc70 0x7f472c0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.236+0000 7f4732400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c0b0360 con 0x7f472c0af630 2024-05-14T15:17:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.236+0000 7f4732400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f472c0b0f70 con 0x7f472c0cfc70 2024-05-14T15:17:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.236+0000 7f4732400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f472c0b0640 con 0x7f472c161f10 2024-05-14T15:17:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.237+0000 7f472be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 0x7f472c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.237+0000 7f4731a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f472c0cfc70 0x7f472c0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.237+0000 7f472be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 0x7f472c0cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:50364/0 (socket says 172.21.15.2:50364) 2024-05-14T15:17:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.237+0000 7f472be00640 1 -- 172.21.15.2:0/648293999 learned_addr learned my addr 172.21.15.2:0/648293999 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.237+0000 7f4731000640 1 --1- 172.21.15.2:0/648293999 >> v1:172.21.15.156:6789/0 conn(0x7f472c0af630 0x7f472c161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.2:54372/0 (socket says 172.21.15.2:54372) 2024-05-14T15:17:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.238+0000 7f472be00640 1 -- 172.21.15.2:0/648293999 >> v2:172.21.15.156:3300/0 conn(0x7f472c0cfc70 msgr2=0x7f472c0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.238+0000 7f472be00640 1 --2- 172.21.15.2:0/648293999 >> v2:172.21.15.156:3300/0 conn(0x7f472c0cfc70 0x7f472c0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.238+0000 7f472be00640 1 -- 172.21.15.2:0/648293999 >> v1:172.21.15.156:6789/0 conn(0x7f472c0af630 legacy=0x7f472c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.238+0000 7f472be00640 1 -- 172.21.15.2:0/648293999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c0b0920 con 0x7f472c161f10 2024-05-14T15:17:04.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.239+0000 7f472be00640 1 --2- 172.21.15.2:0/648293999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 0x7f472c0cf730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4718009870 tx=0x7f471802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2a26926bef8f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.240+0000 7f472b400640 1 -- 172.21.15.2:0/648293999 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718037070 con 0x7f472c161f10 2024-05-14T15:17:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.240+0000 7f472b400640 1 -- 172.21.15.2:0/648293999 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4718032440 con 0x7f472c161f10 2024-05-14T15:17:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.240+0000 7f472b400640 1 -- 172.21.15.2:0/648293999 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718032810 con 0x7f472c161f10 2024-05-14T15:17:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.240+0000 7f4732400640 1 -- 172.21.15.2:0/648293999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 msgr2=0x7f472c0cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.240+0000 7f4732400640 1 --2- 172.21.15.2:0/648293999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 0x7f472c0cf730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4718009870 tx=0x7f471802a250 comp rx=0 tx=0).stop 2024-05-14T15:17:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.241+0000 7f4732400640 1 -- 172.21.15.2:0/648293999 shutdown_connections 2024-05-14T15:17:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.241+0000 7f4732400640 1 --2- 172.21.15.2:0/648293999 >> v2:172.21.15.156:3300/0 conn(0x7f472c0cfc70 0x7f472c0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.241+0000 7f4732400640 1 --2- 172.21.15.2:0/648293999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c161f10 0x7f472c0cf730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.241+0000 7f4732400640 1 -- 172.21.15.2:0/648293999 >> 172.21.15.2:0/648293999 conn(0x7f472c0739a0 msgr2=0x7f472c073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.241+0000 7f4732400640 1 -- 172.21.15.2:0/648293999 shutdown_connections 2024-05-14T15:17:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.241+0000 7f4732400640 1 -- 172.21.15.2:0/648293999 wait complete. 2024-05-14T15:17:04.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.243+0000 7f4732400640 1 Processor -- start 2024-05-14T15:17:04.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.243+0000 7f4732400640 1 -- start start 2024-05-14T15:17:04.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4732400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f472c0af630 0x7f472c13b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4732400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c0cfc70 0x7f472c13c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4732400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 0x7f472c13e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4732400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f472c0afa40 con 0x7f472c13c5e0 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4732400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f472c162560 con 0x7f472c0af630 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4732400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f472c0afbc0 con 0x7f472c0cfc70 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.245+0000 7f4731a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 0x7f472c13e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 0x7f472c13e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56756/0 (socket says 172.21.15.2:56756) 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 -- 172.21.15.2:0/3607435385 learned_addr learned my addr 172.21.15.2:0/3607435385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731000640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f472c0af630 0x7f472c13b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f472be00640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c0cfc70 0x7f472c13c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 -- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c0cfc70 msgr2=0x7f472c13c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c0cfc70 0x7f472c13c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 -- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f472c0af630 msgr2=0x7f472c13b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f472c0af630 0x7f472c13b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f4731a00640 1 -- 172.21.15.2:0/3607435385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c13de30 con 0x7f472c13c5e0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.246+0000 7f472be00640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c0cfc70 0x7f472c13c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.247+0000 7f4731a00640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 0x7f472c13e0f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f472400ef90 tx=0x7f472400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.247+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724018020 con 0x7f472c13c5e0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.247+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4724014480 con 0x7f472c13c5e0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.247+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472c13cd90 con 0x7f472c13c5e0 2024-05-14T15:17:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.247+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724009e60 con 0x7f472c13c5e0 2024-05-14T15:17:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.247+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472c13d350 con 0x7f472c13c5e0 2024-05-14T15:17:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.248+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472c13cb00 con 0x7f472c13c5e0 2024-05-14T15:17:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.250+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4724005d10 con 0x7f472c13c5e0 2024-05-14T15:17:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.251+0000 7f4728c00640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f470c076300 0x7f470c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.251+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f47240980d0 con 0x7f472c13c5e0 2024-05-14T15:17:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.252+0000 7f4731000640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f470c076300 0x7f470c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.253+0000 7f4731000640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f470c076300 0x7f470c078810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4720000f60 tx=0x7f4720000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:04.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.256+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4724022030 con 0x7f472c13c5e0 2024-05-14T15:17:04.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.545+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f472c050870 con 0x7f472c13c5e0 2024-05-14T15:17:04.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.549+0000 7f4728c00640 1 -- 172.21.15.2:0/3607435385 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f4724010040 con 0x7f472c13c5e0 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f470c076300 msgr2=0x7f470c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f470c076300 0x7f470c078810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4720000f60 tx=0x7f4720000bc0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 msgr2=0x7f472c13e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 0x7f472c13e0f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f472400ef90 tx=0x7f472400c490 comp rx=0 tx=0).stop 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 shutdown_connections 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f470c076300 0x7f470c078810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f472c13c5e0 0x7f472c13e0f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f472c0cfc70 0x7f472c13c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 --2- 172.21.15.2:0/3607435385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f472c0af630 0x7f472c13b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 >> 172.21.15.2:0/3607435385 conn(0x7f472c0739a0 msgr2=0x7f472c152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 shutdown_connections 2024-05-14T15:17:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.552+0000 7f4732400640 1 -- 172.21.15.2:0/3607435385 wait complete. 2024-05-14T15:17:04.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T15:17:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.858+0000 7f639fe00640 1 Processor -- start 2024-05-14T15:17:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.858+0000 7f639fe00640 1 -- start start 2024-05-14T15:17:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.861+0000 7f639fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 0x7f63a0070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.861+0000 7f639fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a01618d0 con 0x7f63a006de10 2024-05-14T15:17:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.861+0000 7f639fe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a0161bb0 con 0x7f63a0070e80 2024-05-14T15:17:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.861+0000 7f639fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f63a01624e0 con 0x7f63a00d1050 2024-05-14T15:17:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.861+0000 7f639f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f63a006de10 0x7f63a00ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33608/0 (socket says 172.21.15.2:33608) 2024-05-14T15:17:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.861+0000 7f639f400640 1 -- 172.21.15.2:0/3083760667 learned_addr learned my addr 172.21.15.2:0/3083760667 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639ea00640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 0x7f63a0070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142273833 0 0) 0x7f63a01618d0 con 0x7f63a006de10 2024-05-14T15:17:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6384003520 con 0x7f63a006de10 2024-05-14T15:17:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047132913 0 0) 0x7f6384003520 con 0x7f63a006de10 2024-05-14T15:17:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 msgr2=0x7f63a0070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 0x7f63a0070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 >> v1:172.21.15.156:6789/0 conn(0x7f63a0070e80 legacy=0x7f63a006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a0161e90 con 0x7f63a006de10 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f6398001a70 con 0x7f63a006de10 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 >> v1:172.21.15.2:6789/0 conn(0x7f63a006de10 legacy=0x7f63a00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 0x7f6384003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6384004050 0x7f6384004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.862+0000 7f639e000640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6384004d90 0x7f6384005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63a01624e0 con 0x7f6384004050 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f638400bc50 con 0x7f6384004d90 2024-05-14T15:17:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f638400be50 con 0x7f63a00d1050 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f6397e00640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6384004050 0x7f6384004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f639f400640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6384004d90 0x7f6384005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f6397e00640 1 -- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 msgr2=0x7f6384003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f6397e00640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63a00d1050 0x7f6384003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f6397e00640 1 -- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6384004d90 msgr2=0x7f6384005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f6397e00640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6384004d90 0x7f6384005240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.863+0000 7f6397e00640 1 -- 172.21.15.2:0/3083760667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6384003520 con 0x7f6384004050 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.864+0000 7f6397e00640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6384004050 0x7f6384004800 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6388001760 tx=0x7f6384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412fd9ab5438b5e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.864+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63880013b0 con 0x7f6384004050 2024-05-14T15:17:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.864+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63880052d0 con 0x7f6384004050 2024-05-14T15:17:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.864+0000 7f639e000640 1 -- 172.21.15.2:0/3083760667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638802aaa0 con 0x7f6384004050 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639fe00640 1 -- 172.21.15.2:0/3083760667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6384004050 msgr2=0x7f6384004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639fe00640 1 --2- 172.21.15.2:0/3083760667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6384004050 0x7f6384004800 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6388001760 tx=0x7f6384005830 comp rx=0 tx=0).stop 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639f400640 1 -- 172.21.15.2:0/3083760667 reap_dead start 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639fe00640 1 -- 172.21.15.2:0/3083760667 shutdown_connections 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639fe00640 1 -- 172.21.15.2:0/3083760667 >> 172.21.15.2:0/3083760667 conn(0x7f63a00732e0 msgr2=0x7f63a00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639fe00640 1 -- 172.21.15.2:0/3083760667 shutdown_connections 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.865+0000 7f639fe00640 1 -- 172.21.15.2:0/3083760667 wait complete. 2024-05-14T15:17:04.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.868+0000 7f639fe00640 1 Processor -- start 2024-05-14T15:17:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.868+0000 7f639fe00640 1 -- start start 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.869+0000 7f639fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6384004050 0x7f63a014d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.869+0000 7f639fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 0x7f63a01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.869+0000 7f639fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63a015e870 0x7f63a0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.869+0000 7f639fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63a015f290 con 0x7f63a015cdb0 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.869+0000 7f639fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f63a015f110 con 0x7f63a015e870 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.869+0000 7f639fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f63a0070940 con 0x7f6384004050 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 0x7f63a01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 0x7f63a01555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56776/0 (socket says 172.21.15.2:56776) 2024-05-14T15:17:04.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 -- 172.21.15.2:0/3972189613 learned_addr learned my addr 172.21.15.2:0/3972189613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f639ea00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6384004050 0x7f63a014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 -- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6384004050 msgr2=0x7f63a014d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6384004050 0x7f63a014d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 -- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63a015e870 msgr2=0x7f63a0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63a015e870 0x7f63a0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 -- 172.21.15.2:0/3972189613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a01e7af0 con 0x7f63a015cdb0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.870+0000 7f6397e00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 0x7f63a01555b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6388005040 tx=0x7f6388001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.871+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638803f020 con 0x7f63a015cdb0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.871+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6388005480 con 0x7f63a015cdb0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.871+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388037040 con 0x7f63a015cdb0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.871+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a015d590 con 0x7f63a015cdb0 2024-05-14T15:17:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.871+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a015db50 con 0x7f63a015cdb0 2024-05-14T15:17:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.872+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a0050870 con 0x7f63a015cdb0 2024-05-14T15:17:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.873+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6388042020 con 0x7f63a015cdb0 2024-05-14T15:17:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.874+0000 7f6397400640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f637c076300 0x7f637c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.875+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f63880b7080 con 0x7f63a015cdb0 2024-05-14T15:17:04.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.875+0000 7f639ea00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f637c076300 0x7f637c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:04.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.876+0000 7f639ea00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f637c076300 0x7f637c078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63a0074f20 tx=0x7f6390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:04.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:04.879+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6388049030 con 0x7f63a015cdb0 2024-05-14T15:17:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.089+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f63a00d0b90 con 0x7f63a015cdb0 2024-05-14T15:17:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.090+0000 7f6397400640 1 -- 172.21.15.2:0/3972189613 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7f63a01e7af0 con 0x7f63a015cdb0 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:05.089 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f637c076300 msgr2=0x7f637c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f637c076300 0x7f637c078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63a0074f20 tx=0x7f6390008040 comp rx=0 tx=0).stop 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 msgr2=0x7f63a01555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 0x7f63a01555b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6388005040 tx=0x7f6388001120 comp rx=0 tx=0).stop 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 shutdown_connections 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f637c076300 0x7f637c078810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63a015e870 0x7f63a0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63a015cdb0 0x7f63a01555b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 --2- 172.21.15.2:0/3972189613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6384004050 0x7f63a014d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 >> 172.21.15.2:0/3972189613 conn(0x7f63a00732e0 msgr2=0x7f63a00b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 shutdown_connections 2024-05-14T15:17:05.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.093+0000 7f639fe00640 1 -- 172.21.15.2:0/3972189613 wait complete. 2024-05-14T15:17:05.119 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T15:17:05.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T15:17:05.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.399+0000 7f4ca0c00640 1 Processor -- start 2024-05-14T15:17:05.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.399+0000 7f4ca0c00640 1 -- start start 2024-05-14T15:17:05.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.401+0000 7f4ca0c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 0x7f4c9c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.401+0000 7f4ca0c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9c0d1460 con 0x7f4c9c06d700 2024-05-14T15:17:05.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.402+0000 7f4ca0c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9c15ed90 con 0x7f4c9c071530 2024-05-14T15:17:05.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.402+0000 7f4ca0c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9c15f350 con 0x7f4c9c15bb90 2024-05-14T15:17:05.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.402+0000 7f4c9a800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4c9c06d700 0x7f4c9c06db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33614/0 (socket says 172.21.15.2:33614) 2024-05-14T15:17:05.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.402+0000 7f4c9a800640 1 -- 172.21.15.2:0/3077117383 learned_addr learned my addr 172.21.15.2:0/3077117383 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.402+0000 7f4c99e00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 0x7f4c9c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.402+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928640688 0 0) 0x7f4c9c0d1460 con 0x7f4c9c06d700 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c80003520 con 0x7f4c9c06d700 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 118124007 0 0) 0x7f4c80003520 con 0x7f4c9c06d700 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 msgr2=0x7f4c9c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 0x7f4c9c15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 >> v1:172.21.15.156:6789/0 conn(0x7f4c9c071530 legacy=0x7f4c9c0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c15f070 con 0x7f4c9c06d700 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f4c94001a70 con 0x7f4c9c06d700 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 >> v1:172.21.15.2:6789/0 conn(0x7f4c9c06d700 legacy=0x7f4c9c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c80003a80 0x7f4c80003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c80004800 0x7f4c80004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 0x7f4c8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c15f350 con 0x7f4c80004800 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4c80005590 con 0x7f4c80003a80 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8000bf00 con 0x7f4c9c15bb90 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.403+0000 7f4c99400640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c80004800 0x7f4c80004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c9a800640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 0x7f4c8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c99e00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c80003a80 0x7f4c80003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c99400640 1 -- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 msgr2=0x7f4c8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c99400640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c15bb90 0x7f4c8000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c99400640 1 -- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c80003a80 msgr2=0x7f4c80003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c99400640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c80003a80 0x7f4c80003ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.404+0000 7f4c99400640 1 -- 172.21.15.2:0/3077117383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c80003520 con 0x7f4c80004800 2024-05-14T15:17:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.405+0000 7f4c99400640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c80004800 0x7f4c80004c10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0d2610 tx=0x7f4c80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c1bc9b37847072 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.405+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c880013b0 con 0x7f4c80004800 2024-05-14T15:17:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.405+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c880052d0 con 0x7f4c80004800 2024-05-14T15:17:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.405+0000 7f4c98a00640 1 -- 172.21.15.2:0/3077117383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8802aa50 con 0x7f4c80004800 2024-05-14T15:17:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4ca0c00640 1 -- 172.21.15.2:0/3077117383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c80004800 msgr2=0x7f4c80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/3077117383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c80004800 0x7f4c80004c10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0d2610 tx=0x7f4c80005830 comp rx=0 tx=0).stop 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4c9a800640 1 -- 172.21.15.2:0/3077117383 reap_dead start 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4ca0c00640 1 -- 172.21.15.2:0/3077117383 shutdown_connections 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4ca0c00640 1 -- 172.21.15.2:0/3077117383 >> 172.21.15.2:0/3077117383 conn(0x7f4c9c0d1d10 msgr2=0x7f4c9c0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4ca0c00640 1 -- 172.21.15.2:0/3077117383 shutdown_connections 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.406+0000 7f4ca0c00640 1 -- 172.21.15.2:0/3077117383 wait complete. 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.408+0000 7f4ca0c00640 1 Processor -- start 2024-05-14T15:17:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.409+0000 7f4ca0c00640 1 -- start start 2024-05-14T15:17:05.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4ca0c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c158410 0x7f4c9c1f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4ca0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 0x7f4c9c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4ca0c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c9c0cf6a0 0x7f4c9c0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4ca0c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c0aeb60 con 0x7f4c9c143080 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4ca0c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c0af790 con 0x7f4c9c0cf6a0 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4ca0c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9c15e440 con 0x7f4c9c158410 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4c99400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 0x7f4c9c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4c99400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 0x7f4c9c15a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56800/0 (socket says 172.21.15.2:56800) 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.410+0000 7f4c99400640 1 -- 172.21.15.2:0/600377659 learned_addr learned my addr 172.21.15.2:0/600377659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99e00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c158410 0x7f4c9c1f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99400640 1 -- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c158410 msgr2=0x7f4c9c1f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99400640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c158410 0x7f4c9c1f8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99400640 1 -- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c9c0cf6a0 msgr2=0x7f4c9c0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c9a800640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c9c0cf6a0 0x7f4c9c0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99400640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c9c0cf6a0 0x7f4c9c0cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99400640 1 -- 172.21.15.2:0/600377659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c158820 con 0x7f4c9c143080 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c99400640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 0x7f4c9c15a7d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c88000c00 tx=0x7f4c88001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.411+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88040030 con 0x7f4c9c143080 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.412+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c88005480 con 0x7f4c9c143080 2024-05-14T15:17:05.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.412+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c880050d0 con 0x7f4c9c143080 2024-05-14T15:17:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.412+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9c0cfff0 con 0x7f4c9c143080 2024-05-14T15:17:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.412+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9c158030 con 0x7f4c9c143080 2024-05-14T15:17:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.413+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9c050870 con 0x7f4c9c143080 2024-05-14T15:17:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.414+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c88043070 con 0x7f4c9c143080 2024-05-14T15:17:05.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.415+0000 7f4c92000640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4c7c0762d0 0x7f4c7c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.415+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f4c880b7230 con 0x7f4c9c143080 2024-05-14T15:17:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.416+0000 7f4c99e00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4c7c0762d0 0x7f4c7c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:05.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.417+0000 7f4c99e00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4c7c0762d0 0x7f4c7c0787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c14c6b0 tx=0x7f4c8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:05.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.420+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4c9c0cfff0 con 0x7f4c9c143080 2024-05-14T15:17:05.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:05.620+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4c9c069ad0 con 0x7f4c9c143080 2024-05-14T15:17:06.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-05-14T15:17:06.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-14T15:17:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.570+0000 7f4c92000640 1 -- 172.21.15.2:0/600377659 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7f4c9c158820 con 0x7f4c9c143080 2024-05-14T15:17:06.570 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-05-14T15:17:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.573+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4c7c0762d0 msgr2=0x7f4c7c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:06.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.573+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4c7c0762d0 0x7f4c7c0787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c14c6b0 tx=0x7f4c8c008040 comp rx=0 tx=0).stop 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.573+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 msgr2=0x7f4c9c15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.573+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 0x7f4c9c15a7d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c88000c00 tx=0x7f4c88001120 comp rx=0 tx=0).stop 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 shutdown_connections 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4c7c0762d0 0x7f4c7c0787e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c9c0cf6a0 0x7f4c9c0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c143080 0x7f4c9c15a7d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 --2- 172.21.15.2:0/600377659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c9c158410 0x7f4c9c1f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 >> 172.21.15.2:0/600377659 conn(0x7f4c9c0d1d10 msgr2=0x7f4c9c0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:06.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 shutdown_connections 2024-05-14T15:17:06.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.574+0000 7f4ca0c00640 1 -- 172.21.15.2:0/600377659 wait complete. 2024-05-14T15:17:06.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T15:17:06.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.890+0000 7f6506600640 1 Processor -- start 2024-05-14T15:17:06.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.890+0000 7f6506600640 1 -- start start 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f6506600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f650015ffa0 0x7f65000cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f6506600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f65000b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f6506600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65000b2ad0 con 0x7f65000d2e00 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f6506600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f65000b68b0 con 0x7f650015ffa0 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f6506600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f65000b2db0 con 0x7f65000ce340 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f64ffe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f650015ffa0 0x7f65000cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f64ffe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f650015ffa0 0x7f65000cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56802/0 (socket says 172.21.15.2:56802) 2024-05-14T15:17:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.892+0000 7f64ffe00640 1 -- 172.21.15.2:0/412206093 learned_addr learned my addr 172.21.15.2:0/412206093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.893+0000 7f6505c00640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f65000b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.893+0000 7f64ffe00640 1 -- 172.21.15.2:0/412206093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 msgr2=0x7f65000b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.893+0000 7f64ffe00640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f65000b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.893+0000 7f64ffe00640 1 -- 172.21.15.2:0/412206093 >> v1:172.21.15.156:6789/0 conn(0x7f65000d2e00 legacy=0x7f65000d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.893+0000 7f64ffe00640 1 -- 172.21.15.2:0/412206093 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65000b8000 con 0x7f650015ffa0 2024-05-14T15:17:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.893+0000 7f6505c00640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f65000b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.894+0000 7f64ffe00640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f65000cde00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009870 tx=0x7f64ec02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934c4e7fa03c51fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.894+0000 7f64ff400640 1 -- 172.21.15.2:0/412206093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec037070 con 0x7f650015ffa0 2024-05-14T15:17:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f64ff400640 1 -- 172.21.15.2:0/412206093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ec032440 con 0x7f650015ffa0 2024-05-14T15:17:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f64ff400640 1 -- 172.21.15.2:0/412206093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec032810 con 0x7f650015ffa0 2024-05-14T15:17:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f6506600640 1 -- 172.21.15.2:0/412206093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 msgr2=0x7f65000cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f6506600640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f65000cde00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009870 tx=0x7f64ec02a130 comp rx=0 tx=0).stop 2024-05-14T15:17:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f6506600640 1 -- 172.21.15.2:0/412206093 shutdown_connections 2024-05-14T15:17:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f6506600640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f65000b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f6506600640 1 --2- 172.21.15.2:0/412206093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f65000cde00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.895+0000 7f6506600640 1 -- 172.21.15.2:0/412206093 >> 172.21.15.2:0/412206093 conn(0x7f65000b52e0 msgr2=0x7f65000b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.896+0000 7f6506600640 1 -- 172.21.15.2:0/412206093 shutdown_connections 2024-05-14T15:17:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.896+0000 7f6506600640 1 -- 172.21.15.2:0/412206093 wait complete. 2024-05-14T15:17:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.898+0000 7f6506600640 1 Processor -- start 2024-05-14T15:17:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.898+0000 7f6506600640 1 -- start start 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6506600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f650006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6506600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65000d2e00 0x7f65001f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6506600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f6500147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6506600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f65000b8d40 con 0x7f650015ffa0 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6506600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f65000b7cb0 con 0x7f65000d2e00 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6506600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f65000b8ec0 con 0x7f65000ce340 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6505c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f6500147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6505c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f6500147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56814/0 (socket says 172.21.15.2:56814) 2024-05-14T15:17:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.900+0000 7f6505c00640 1 -- 172.21.15.2:0/286788539 learned_addr learned my addr 172.21.15.2:0/286788539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505200640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f650006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f64ffe00640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65000d2e00 0x7f65001f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505c00640 1 -- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 msgr2=0x7f650006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505c00640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f650006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505c00640 1 -- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65000d2e00 msgr2=0x7f65001f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505c00640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65000d2e00 0x7f65001f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505c00640 1 -- 172.21.15.2:0/286788539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650015e0d0 con 0x7f650015ffa0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f6505c00640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f6500147e60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f64f800cd80 tx=0x7f64f800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.901+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f800f680 con 0x7f650015ffa0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.902+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f800f840 con 0x7f650015ffa0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.902+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650006ea10 con 0x7f650015ffa0 2024-05-14T15:17:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.902+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f800fc30 con 0x7f650015ffa0 2024-05-14T15:17:06.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.902+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650015e340 con 0x7f650015ffa0 2024-05-14T15:17:06.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.903+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6500160700 con 0x7f650015ffa0 2024-05-14T15:17:06.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.905+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64f80213f0 con 0x7f650015ffa0 2024-05-14T15:17:06.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.906+0000 7f64fcc00640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f64e0076300 0x7f64e0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:06.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.906+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f64f8098380 con 0x7f650015ffa0 2024-05-14T15:17:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.906+0000 7f6505200640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f64e0076300 0x7f64e0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:06.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.908+0000 7f6505200640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f64e0076300 0x7f64e0078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f64f000a750 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:06.912+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64f8014030 con 0x7f650015ffa0 2024-05-14T15:17:07.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.126+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6500050870 con 0x7f650015ffa0 2024-05-14T15:17:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.577+0000 7f64fcc00640 1 -- 172.21.15.2:0/286788539 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f64f8061c90 con 0x7f650015ffa0 2024-05-14T15:17:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f64e0076300 msgr2=0x7f64e0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f64e0076300 0x7f64e0078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f64f000a750 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 msgr2=0x7f6500147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f6500147e60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f64f800cd80 tx=0x7f64f800a650 comp rx=0 tx=0).stop 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 shutdown_connections 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f64e0076300 0x7f64e0078810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65000d2e00 0x7f65001f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f650015ffa0 0x7f6500147e60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 --2- 172.21.15.2:0/286788539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65000ce340 0x7f650006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 >> 172.21.15.2:0/286788539 conn(0x7f65000b52e0 msgr2=0x7f65000ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 shutdown_connections 2024-05-14T15:17:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.581+0000 7f6506600640 1 -- 172.21.15.2:0/286788539 wait complete. 2024-05-14T15:17:07.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T15:17:07.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.887+0000 7f7de5000640 1 Processor -- start 2024-05-14T15:17:07.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.887+0000 7f7de5000640 1 -- start start 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7de5000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de00709e0 0x7f7de00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7de5000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7de01618e0 0x7f7de0161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7de5000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de0162230 con 0x7f7de015e2f0 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7de5000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7de00aee60 con 0x7f7de01618e0 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7de5000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7de00af140 con 0x7f7de00709e0 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7dd7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7de01618e0 0x7f7de0161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7dd7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7de01618e0 0x7f7de0161cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56828/0 (socket says 172.21.15.2:56828) 2024-05-14T15:17:07.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.890+0000 7f7dd7e00640 1 -- 172.21.15.2:0/522478802 learned_addr learned my addr 172.21.15.2:0/522478802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.891+0000 7f7ddf400640 1 --2- 172.21.15.2:0/522478802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de00709e0 0x7f7de00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.891+0000 7f7dd7e00640 1 -- 172.21.15.2:0/522478802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de00709e0 msgr2=0x7f7de00b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.891+0000 7f7dd7e00640 1 --2- 172.21.15.2:0/522478802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de00709e0 0x7f7de00b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.891+0000 7f7dd7e00640 1 -- 172.21.15.2:0/522478802 >> v1:172.21.15.156:6789/0 conn(0x7f7de015e2f0 legacy=0x7f7de015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:07.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.891+0000 7f7dd7e00640 1 -- 172.21.15.2:0/522478802 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de00af420 con 0x7f7de01618e0 2024-05-14T15:17:07.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.892+0000 7f7dd7e00640 1 --2- 172.21.15.2:0/522478802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de01618e0 0x7f7de0161cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1039ce8ec56934a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:07.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.893+0000 7f7ddea00640 1 -- 172.21.15.2:0/522478802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8037070 con 0x7f7de01618e0 2024-05-14T15:17:07.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.893+0000 7f7ddea00640 1 -- 172.21.15.2:0/522478802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc8032440 con 0x7f7de01618e0 2024-05-14T15:17:07.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.893+0000 7f7ddea00640 1 -- 172.21.15.2:0/522478802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8032810 con 0x7f7de01618e0 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 -- 172.21.15.2:0/522478802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de01618e0 msgr2=0x7f7de0161cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 --2- 172.21.15.2:0/522478802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de01618e0 0x7f7de0161cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc802a130 comp rx=0 tx=0).stop 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 -- 172.21.15.2:0/522478802 shutdown_connections 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 --2- 172.21.15.2:0/522478802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de01618e0 0x7f7de0161cf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 --2- 172.21.15.2:0/522478802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de00709e0 0x7f7de00b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 -- 172.21.15.2:0/522478802 >> 172.21.15.2:0/522478802 conn(0x7f7de00739a0 msgr2=0x7f7de0073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 -- 172.21.15.2:0/522478802 shutdown_connections 2024-05-14T15:17:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.894+0000 7f7de5000640 1 -- 172.21.15.2:0/522478802 wait complete. 2024-05-14T15:17:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.897+0000 7f7de5000640 1 Processor -- start 2024-05-14T15:17:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.898+0000 7f7de5000640 1 -- start start 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.899+0000 7f7de5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 0x7f7de01f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.899+0000 7f7de5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7de015e2f0 0x7f7de01f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.899+0000 7f7de5000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de01618e0 0x7f7de01f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.899+0000 7f7de5000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7de0070df0 con 0x7f7de00709e0 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.899+0000 7f7de5000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00af9e0 con 0x7f7de015e2f0 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.899+0000 7f7de5000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f7de01626c0 con 0x7f7de01618e0 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 0x7f7de01f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 0x7f7de01f38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56836/0 (socket says 172.21.15.2:56836) 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 -- 172.21.15.2:0/2129558689 learned_addr learned my addr 172.21.15.2:0/2129558689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7dd7e00640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7de015e2f0 0x7f7de01f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 -- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de01618e0 msgr2=0x7f7de01f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddfe00640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de01618e0 0x7f7de01f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de01618e0 0x7f7de01f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 -- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7de015e2f0 msgr2=0x7f7de01f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7de015e2f0 0x7f7de01f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.900+0000 7f7ddf400640 1 -- 172.21.15.2:0/2129558689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de01f6d10 con 0x7f7de00709e0 2024-05-14T15:17:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.901+0000 7f7ddf400640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 0x7f7de01f38f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d600 tx=0x7f7dd000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.901+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004240 con 0x7f7de00709e0 2024-05-14T15:17:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.901+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00043e0 con 0x7f7de00709e0 2024-05-14T15:17:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.901+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0003830 con 0x7f7de00709e0 2024-05-14T15:17:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.901+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de01f6ff0 con 0x7f7de00709e0 2024-05-14T15:17:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.901+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de01f6760 con 0x7f7de00709e0 2024-05-14T15:17:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.903+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de0050870 con 0x7f7de00709e0 2024-05-14T15:17:07.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.904+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7dd00039d0 con 0x7f7de00709e0 2024-05-14T15:17:07.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.905+0000 7f7dd7400640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dbc0762d0 0x7f7dbc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.905+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7f7dd0098360 con 0x7f7de00709e0 2024-05-14T15:17:07.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.906+0000 7f7dd7e00640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dbc0762d0 0x7f7dbc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.907+0000 7f7dd7e00640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dbc0762d0 0x7f7dbc0787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8034000 tx=0x7f7dc802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:07.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:07.909+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7dd0061d00 con 0x7f7de00709e0 2024-05-14T15:17:08.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.155+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7de0070280 con 0x7f7de00709e0 2024-05-14T15:17:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.601+0000 7f7dd7400640 1 -- 172.21.15.2:0/2129558689 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f7dd0061600 con 0x7f7de00709e0 2024-05-14T15:17:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 5 and data pool 6 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dbc0762d0 msgr2=0x7f7dbc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dbc0762d0 0x7f7dbc0787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8034000 tx=0x7f7dc802e000 comp rx=0 tx=0).stop 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 msgr2=0x7f7de01f38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 0x7f7de01f38f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d600 tx=0x7f7dd000dac0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 shutdown_connections 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7dbc0762d0 0x7f7dbc0787e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7de015e2f0 0x7f7de01f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7de01618e0 0x7f7de01f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 --2- 172.21.15.2:0/2129558689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de00709e0 0x7f7de01f38f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.605+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 >> 172.21.15.2:0/2129558689 conn(0x7f7de00739a0 msgr2=0x7f7de00d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:08.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.606+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 shutdown_connections 2024-05-14T15:17:08.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.606+0000 7f7de5000640 1 -- 172.21.15.2:0/2129558689 wait complete. 2024-05-14T15:17:08.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:17:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.900+0000 7f2b54a00640 1 Processor -- start 2024-05-14T15:17:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.900+0000 7f2b54a00640 1 -- start start 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.901+0000 7f2b54a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b500b2bc0 0x7f2b5015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b54a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b500cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b54a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b500d14d0 con 0x7f2b500cde20 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b54a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2b50160500 con 0x7f2b500b2bc0 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b54a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f2b500d17b0 con 0x7f2b500ce940 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b500b2bc0 0x7f2b5015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b500b2bc0 0x7f2b5015ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56842/0 (socket says 172.21.15.2:56842) 2024-05-14T15:17:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 -- 172.21.15.2:0/327428742 learned_addr learned my addr 172.21.15.2:0/327428742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 -- 172.21.15.2:0/327428742 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 msgr2=0x7f2b500cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 --2- 172.21.15.2:0/327428742 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b500cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 -- 172.21.15.2:0/327428742 >> v1:172.21.15.156:6789/0 conn(0x7f2b500cde20 legacy=0x7f2b500ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.902+0000 7f2b4f400640 1 -- 172.21.15.2:0/327428742 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b500d1a90 con 0x7f2b500b2bc0 2024-05-14T15:17:08.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.903+0000 7f2b4f400640 1 --2- 172.21.15.2:0/327428742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b5015ffc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009870 tx=0x7f2b4002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0604958219aa6a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.904+0000 7f2b4e000640 1 -- 172.21.15.2:0/327428742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40037070 con 0x7f2b500b2bc0 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.904+0000 7f2b4e000640 1 -- 172.21.15.2:0/327428742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4002adf0 con 0x7f2b500b2bc0 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.904+0000 7f2b4e000640 1 -- 172.21.15.2:0/327428742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40032660 con 0x7f2b500b2bc0 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.904+0000 7f2b54a00640 1 -- 172.21.15.2:0/327428742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 msgr2=0x7f2b5015ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.904+0000 7f2b54a00640 1 --2- 172.21.15.2:0/327428742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b5015ffc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009870 tx=0x7f2b4002a0a0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.905+0000 7f2b54a00640 1 -- 172.21.15.2:0/327428742 shutdown_connections 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.905+0000 7f2b54a00640 1 --2- 172.21.15.2:0/327428742 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b500cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.905+0000 7f2b54a00640 1 --2- 172.21.15.2:0/327428742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b5015ffc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.905+0000 7f2b54a00640 1 -- 172.21.15.2:0/327428742 >> 172.21.15.2:0/327428742 conn(0x7f2b500b52e0 msgr2=0x7f2b500b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.905+0000 7f2b54a00640 1 -- 172.21.15.2:0/327428742 shutdown_connections 2024-05-14T15:17:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.905+0000 7f2b54a00640 1 -- 172.21.15.2:0/327428742 wait complete. 2024-05-14T15:17:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.907+0000 7f2b54a00640 1 Processor -- start 2024-05-14T15:17:08.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.907+0000 7f2b54a00640 1 -- start start 2024-05-14T15:17:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.908+0000 7f2b54a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b500affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b54a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b500cde20 0x7f2b50162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b54a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b5014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:08.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b54a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b500cff90 con 0x7f2b500b2bc0 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b54a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2b500b7d00 con 0x7f2b500cde20 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b54a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f2b500d0110 con 0x7f2b500ce940 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b500affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b500affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56854/0 (socket says 172.21.15.2:56854) 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 -- 172.21.15.2:0/3304485962 learned_addr learned my addr 172.21.15.2:0/3304485962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4fe00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b5014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 -- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 msgr2=0x7f2b5014bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4ea00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b500cde20 0x7f2b50162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b5014bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 -- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b500cde20 msgr2=0x7f2b50162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:08.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b500cde20 0x7f2b50162590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.909+0000 7f2b4f400640 1 -- 172.21.15.2:0/3304485962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5014ad00 con 0x7f2b500b2bc0 2024-05-14T15:17:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.910+0000 7f2b4f400640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b500affe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009870 tx=0x7f2b400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.910+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40042020 con 0x7f2b500b2bc0 2024-05-14T15:17:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.910+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4003c680 con 0x7f2b500b2bc0 2024-05-14T15:17:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.910+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40037040 con 0x7f2b500b2bc0 2024-05-14T15:17:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.910+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5014afe0 con 0x7f2b500b2bc0 2024-05-14T15:17:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.910+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5014b5a0 con 0x7f2b500b2bc0 2024-05-14T15:17:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.911+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b50050870 con 0x7f2b500b2bc0 2024-05-14T15:17:08.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.913+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b40045020 con 0x7f2b500b2bc0 2024-05-14T15:17:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.914+0000 7f2b47400640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2b300762d0 0x7f2b300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.914+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2b400b7df0 con 0x7f2b500b2bc0 2024-05-14T15:17:08.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.915+0000 7f2b4ea00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2b300762d0 0x7f2b300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:08.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.916+0000 7f2b4ea00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2b300762d0 0x7f2b300787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c006fd0 tx=0x7f2b3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:08.920+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b4004c030 con 0x7f2b500b2bc0 2024-05-14T15:17:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.130+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b500d2c50 con 0x7f2b500b2bc0 2024-05-14T15:17:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.134+0000 7f2b47400640 1 -- 172.21.15.2:0/3304485962 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16883 (secure 0 0 0) 0x7f2b40081520 con 0x7f2b500b2bc0 2024-05-14T15:17:09.133 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:09.133 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:17:08.156604+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:17:05.637911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T15:17:07.143749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.136+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2b300762d0 msgr2=0x7f2b300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.136+0000 7f2b54a00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2b300762d0 0x7f2b300787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c006fd0 tx=0x7f2b3c008040 comp rx=0 tx=0).stop 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.136+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 msgr2=0x7f2b500affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.136+0000 7f2b54a00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b500affe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009870 tx=0x7f2b400046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 shutdown_connections 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2b300762d0 0x7f2b300787e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b500cde20 0x7f2b50162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b500ce940 0x7f2b5014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 --2- 172.21.15.2:0/3304485962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b500b2bc0 0x7f2b500affe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 >> 172.21.15.2:0/3304485962 conn(0x7f2b500b52e0 msgr2=0x7f2b500b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:09.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 shutdown_connections 2024-05-14T15:17:09.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.137+0000 7f2b54a00640 1 -- 172.21.15.2:0/3304485962 wait complete. 2024-05-14T15:17:09.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:17:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.444+0000 7f2e26a00640 1 Processor -- start 2024-05-14T15:17:09.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.444+0000 7f2e26a00640 1 -- start start 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e26a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e200b56a0 0x7f2e200b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e26a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e2006d700 0x7f2e2006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e26a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e200b5ab0 con 0x7f2e2015ca80 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e26a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2e2006e050 con 0x7f2e2006d700 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e26a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f2e200b0d10 con 0x7f2e200b56a0 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e24c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2e2015ca80 0x7f2e200b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33622/0 (socket says 172.21.15.2:33622) 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e24c00640 1 -- 172.21.15.2:0/224768574 learned_addr learned my addr 172.21.15.2:0/224768574 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e26000640 1 --2- 172.21.15.2:0/224768574 >> v2:172.21.15.2:3300/0 conn(0x7f2e2006d700 0x7f2e2006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.447+0000 7f2e25600640 1 --2- 172.21.15.2:0/224768574 >> v2:172.21.15.156:3300/0 conn(0x7f2e200b56a0 0x7f2e200b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.448+0000 7f2e26000640 1 -- 172.21.15.2:0/224768574 >> v2:172.21.15.156:3300/0 conn(0x7f2e200b56a0 msgr2=0x7f2e200b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.448+0000 7f2e26000640 1 --2- 172.21.15.2:0/224768574 >> v2:172.21.15.156:3300/0 conn(0x7f2e200b56a0 0x7f2e200b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.448+0000 7f2e26000640 1 -- 172.21.15.2:0/224768574 >> v1:172.21.15.2:6789/0 conn(0x7f2e2015ca80 legacy=0x7f2e200b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.448+0000 7f2e26000640 1 -- 172.21.15.2:0/224768574 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e200b0ff0 con 0x7f2e2006d700 2024-05-14T15:17:09.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.448+0000 7f2e1fe00640 1 -- 172.21.15.2:0/224768574 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179885394 0 0) 0x7f2e0c001110 con 0x7f2e2015ca80 2024-05-14T15:17:09.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.449+0000 7f2e26000640 1 --2- 172.21.15.2:0/224768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e2006d700 0x7f2e2006db10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e20072d90 tx=0x7f2e1802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a17724cea46ca73 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:09.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.449+0000 7f2e1fe00640 1 -- 172.21.15.2:0/224768574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18007740 con 0x7f2e2006d700 2024-05-14T15:17:09.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.449+0000 7f2e1fe00640 1 -- 172.21.15.2:0/224768574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e180078e0 con 0x7f2e2006d700 2024-05-14T15:17:09.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.449+0000 7f2e1fe00640 1 -- 172.21.15.2:0/224768574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18007cb0 con 0x7f2e2006d700 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 -- 172.21.15.2:0/224768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e2006d700 msgr2=0x7f2e2006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 --2- 172.21.15.2:0/224768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e2006d700 0x7f2e2006db10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e20072d90 tx=0x7f2e1802a680 comp rx=0 tx=0).stop 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 -- 172.21.15.2:0/224768574 shutdown_connections 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 --2- 172.21.15.2:0/224768574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e2006d700 0x7f2e2006db10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 --2- 172.21.15.2:0/224768574 >> v2:172.21.15.156:3300/0 conn(0x7f2e200b56a0 0x7f2e200b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 -- 172.21.15.2:0/224768574 >> 172.21.15.2:0/224768574 conn(0x7f2e200732e0 msgr2=0x7f2e200736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 -- 172.21.15.2:0/224768574 shutdown_connections 2024-05-14T15:17:09.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.450+0000 7f2e26a00640 1 -- 172.21.15.2:0/224768574 wait complete. 2024-05-14T15:17:09.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.453+0000 7f2e26a00640 1 Processor -- start 2024-05-14T15:17:09.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.453+0000 7f2e26a00640 1 -- start start 2024-05-14T15:17:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.454+0000 7f2e26a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2006d700 0x7f2e200c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.454+0000 7f2e26a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 0x7f2e2014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.454+0000 7f2e26a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2015ca80 0x7f2e2014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.454+0000 7f2e26a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200b5180 con 0x7f2e200b56a0 2024-05-14T15:17:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.454+0000 7f2e26a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200b4ea0 con 0x7f2e2015ca80 2024-05-14T15:17:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.454+0000 7f2e26a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2015ce90 con 0x7f2e2006d700 2024-05-14T15:17:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 0x7f2e2014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 0x7f2e2014e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56862/0 (socket says 172.21.15.2:56862) 2024-05-14T15:17:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 -- 172.21.15.2:0/2096245275 learned_addr learned my addr 172.21.15.2:0/2096245275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e25600640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2006d700 0x7f2e200c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e26000640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2015ca80 0x7f2e2014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 -- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2006d700 msgr2=0x7f2e200c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2006d700 0x7f2e200c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 -- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2015ca80 msgr2=0x7f2e2014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2015ca80 0x7f2e2014bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e24c00640 1 -- 172.21.15.2:0/2096245275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e20158280 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.455+0000 7f2e25600640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2006d700 0x7f2e200c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.456+0000 7f2e24c00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 0x7f2e2014e430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c3f0 tx=0x7f2e0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.456+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0074e0 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.456+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0047e0 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.456+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c004bd0 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.456+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e20158560 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.456+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e20158b20 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.457+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e20073780 con 0x7f2e200b56a0 2024-05-14T15:17:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.459+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e0c011070 con 0x7f2e200b56a0 2024-05-14T15:17:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.460+0000 7f2e1d600640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2e000762d0 0x7f2e000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.460+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2e0c097450 con 0x7f2e200b56a0 2024-05-14T15:17:09.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.460+0000 7f2e25600640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2e000762d0 0x7f2e000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.462+0000 7f2e25600640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2e000762d0 0x7f2e000787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e14006fd0 tx=0x7f2e14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:09.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.464+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e200b5ab0 con 0x7f2e200b56a0 2024-05-14T15:17:09.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.680+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e20158010 con 0x7f2e200b56a0 2024-05-14T15:17:09.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.681+0000 7f2e1d600640 1 -- 172.21.15.2:0/2096245275 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16870 (secure 0 0 0) 0x7f2e0c060b80 con 0x7f2e200b56a0 2024-05-14T15:17:09.680 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":40,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:17:09.627702+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:17:05.637911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T15:17:07.143749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:17:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2e000762d0 msgr2=0x7f2e000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2e000762d0 0x7f2e000787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e14006fd0 tx=0x7f2e14008040 comp rx=0 tx=0).stop 2024-05-14T15:17:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 msgr2=0x7f2e2014e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 0x7f2e2014e430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c3f0 tx=0x7f2e0c00c8b0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 shutdown_connections 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f2e000762d0 0x7f2e000787e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2015ca80 0x7f2e2014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e200b56a0 0x7f2e2014e430 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 --2- 172.21.15.2:0/2096245275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2006d700 0x7f2e200c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 >> 172.21.15.2:0/2096245275 conn(0x7f2e200732e0 msgr2=0x7f2e200b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 shutdown_connections 2024-05-14T15:17:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.684+0000 7f2e26a00640 1 -- 172.21.15.2:0/2096245275 wait complete. 2024-05-14T15:17:09.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T15:17:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.999+0000 7f1447e00640 1 Processor -- start 2024-05-14T15:17:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:09.999+0000 7f1447e00640 1 -- start start 2024-05-14T15:17:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.001+0000 7f1447e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f14481617f0 0x7f1448161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.001+0000 7f1447e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1448162140 con 0x7f144806f0f0 2024-05-14T15:17:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.001+0000 7f1447e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14480aecc0 con 0x7f1448162390 2024-05-14T15:17:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.001+0000 7f1447e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f14480aefa0 con 0x7f14481617f0 2024-05-14T15:17:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.002+0000 7f1447400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f144806f0f0 0x7f144806f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41568/0 (socket says 172.21.15.2:41568) 2024-05-14T15:17:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.002+0000 7f1447400640 1 -- 172.21.15.2:0/2112691673 learned_addr learned my addr 172.21.15.2:0/2112691673 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.002+0000 7f143e000640 1 --2- 172.21.15.2:0/2112691673 >> v2:172.21.15.156:3300/0 conn(0x7f14481617f0 0x7f1448161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.002+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147423466 0 0) 0x7f1440001110 con 0x7f144806f0f0 2024-05-14T15:17:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.002+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f142c003520 con 0x7f144806f0f0 2024-05-14T15:17:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3395409627 0 0) 0x7f142c003520 con 0x7f144806f0f0 2024-05-14T15:17:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 >> v2:172.21.15.156:3300/0 conn(0x7f14481617f0 msgr2=0x7f1448161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 --2- 172.21.15.2:0/2112691673 >> v2:172.21.15.156:3300/0 conn(0x7f14481617f0 0x7f1448161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 >> v1:172.21.15.156:6789/0 conn(0x7f1448162390 legacy=0x7f14480b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14480af280 con 0x7f144806f0f0 2024-05-14T15:17:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f14400018c0 con 0x7f144806f0f0 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 >> v1:172.21.15.2:6789/0 conn(0x7f144806f0f0 legacy=0x7f144806f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c003a50 0x7f142c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142c004800 0x7f142c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c005250 0x7f142c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14480aefa0 con 0x7f142c005250 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f142c00c1e0 con 0x7f142c004800 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f142c00c3e0 con 0x7f142c003a50 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.003+0000 7f1447400640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c005250 0x7f142c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f143e000640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142c004800 0x7f142c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f1446a00640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c003a50 0x7f142c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f1447400640 1 -- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c003a50 msgr2=0x7f142c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f1447400640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c003a50 0x7f142c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f1447400640 1 -- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142c004800 msgr2=0x7f142c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f1447400640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142c004800 0x7f142c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.004+0000 7f1447400640 1 -- 172.21.15.2:0/2112691673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c003520 con 0x7f142c005250 2024-05-14T15:17:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.005+0000 7f1447400640 1 -- 172.21.15.2:0/2112691673 reap_dead start 2024-05-14T15:17:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.005+0000 7f1447400640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c005250 0x7f142c00b9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f144000c490 tx=0x7f142c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac2a81118464922 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.005+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440035070 con 0x7f142c005250 2024-05-14T15:17:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.005+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1440005ad0 con 0x7f142c005250 2024-05-14T15:17:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.005+0000 7f1446000640 1 -- 172.21.15.2:0/2112691673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144000c0e0 con 0x7f142c005250 2024-05-14T15:17:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 -- 172.21.15.2:0/2112691673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c005250 msgr2=0x7f142c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c005250 0x7f142c00b9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f144000c490 tx=0x7f142c005830 comp rx=0 tx=0).stop 2024-05-14T15:17:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 -- 172.21.15.2:0/2112691673 shutdown_connections 2024-05-14T15:17:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 --2- 172.21.15.2:0/2112691673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c005250 0x7f142c00b9c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 -- 172.21.15.2:0/2112691673 >> 172.21.15.2:0/2112691673 conn(0x7f14480739a0 msgr2=0x7f1448073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 -- 172.21.15.2:0/2112691673 shutdown_connections 2024-05-14T15:17:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.006+0000 7f1447e00640 1 -- 172.21.15.2:0/2112691673 wait complete. 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.009+0000 7f1447e00640 1 Processor -- start 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.009+0000 7f1447e00640 1 -- start start 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.010+0000 7f1447e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c005250 0x7f14480b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.010+0000 7f1447e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480afc60 0x7f14481603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.010+0000 7f1447e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 0x7f144814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.010+0000 7f1447e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1448161c00 con 0x7f144814f9a0 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.010+0000 7f1447e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f144815bb60 con 0x7f14480afc60 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.010+0000 7f1447e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1448161d80 con 0x7f142c005250 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 0x7f144814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 0x7f144814fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58686/0 (socket says 172.21.15.2:58686) 2024-05-14T15:17:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 -- 172.21.15.2:0/1642219708 learned_addr learned my addr 172.21.15.2:0/1642219708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1446a00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c005250 0x7f14480b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f143e000640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480afc60 0x7f14481603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 -- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c005250 msgr2=0x7f14480b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c005250 0x7f14480b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 -- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480afc60 msgr2=0x7f14481603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480afc60 0x7f14481603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.011+0000 7f1447400640 1 -- 172.21.15.2:0/1642219708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14481519d0 con 0x7f144814f9a0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.012+0000 7f1447400640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 0x7f144814fdb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1440033040 tx=0x7f14480aee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.012+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440035040 con 0x7f144814f9a0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.012+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1440041070 con 0x7f144814f9a0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.012+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1448151cb0 con 0x7f144814f9a0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.012+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144002c040 con 0x7f144814f9a0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.012+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14480b03b0 con 0x7f144814f9a0 2024-05-14T15:17:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.013+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14480b0610 con 0x7f144814f9a0 2024-05-14T15:17:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.015+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f14400074d0 con 0x7f144814f9a0 2024-05-14T15:17:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.016+0000 7f143f400640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14240762d0 0x7f14240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.016+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f14400b72b0 con 0x7f144814f9a0 2024-05-14T15:17:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.016+0000 7f1446a00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14240762d0 0x7f14240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.018+0000 7f1446a00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14240762d0 0x7f14240787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1448071060 tx=0x7f1438009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.020+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1448162140 con 0x7f144814f9a0 2024-05-14T15:17:10.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.279+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f14480b6860 con 0x7f144814f9a0 2024-05-14T15:17:10.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:10.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:10.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.656+0000 7f143f400640 1 -- 172.21.15.2:0/1642219708 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f1440080a00 con 0x7f144814f9a0 2024-05-14T15:17:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.660+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14240762d0 msgr2=0x7f14240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.660+0000 7f1447e00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14240762d0 0x7f14240787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1448071060 tx=0x7f1438009040 comp rx=0 tx=0).stop 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.660+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 msgr2=0x7f144814fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.660+0000 7f1447e00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 0x7f144814fdb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1440033040 tx=0x7f14480aee90 comp rx=0 tx=0).stop 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 shutdown_connections 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f14240762d0 0x7f14240787e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480afc60 0x7f14481603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f144814f9a0 0x7f144814fdb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 --2- 172.21.15.2:0/1642219708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f142c005250 0x7f14480b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 >> 172.21.15.2:0/1642219708 conn(0x7f14480739a0 msgr2=0x7f14480d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 shutdown_connections 2024-05-14T15:17:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:10.661+0000 7f1447e00640 1 -- 172.21.15.2:0/1642219708 wait complete. 2024-05-14T15:17:10.688 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-14T15:17:10.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T15:17:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.023+0000 7f4412c00640 1 Processor -- start 2024-05-14T15:17:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.023+0000 7f4412c00640 1 -- start start 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.025+0000 7f4412c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f440c0d0f80 0x7f440c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.025+0000 7f4412c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f440c0d2460 0x7f440c0b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440c0b46f0 con 0x7f440c0b41e0 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f440c1617b0 con 0x7f440c0d2460 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f440c0b6870 con 0x7f440c0d0f80 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f440c0d2460 0x7f440c0b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f440c0d2460 0x7f440c0b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58700/0 (socket says 172.21.15.2:58700) 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 -- 172.21.15.2:0/3054579233 learned_addr learned my addr 172.21.15.2:0/3054579233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4410e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f440c0b41e0 0x7f440c0d1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41582/0 (socket says 172.21.15.2:41582) 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4411800640 1 --2- 172.21.15.2:0/3054579233 >> v2:172.21.15.156:3300/0 conn(0x7f440c0d0f80 0x7f440c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 -- 172.21.15.2:0/3054579233 >> v2:172.21.15.156:3300/0 conn(0x7f440c0d0f80 msgr2=0x7f440c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 --2- 172.21.15.2:0/3054579233 >> v2:172.21.15.156:3300/0 conn(0x7f440c0d0f80 0x7f440c0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 -- 172.21.15.2:0/3054579233 >> v1:172.21.15.2:6789/0 conn(0x7f440c0b41e0 legacy=0x7f440c0d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4412200640 1 -- 172.21.15.2:0/3054579233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c0b49d0 con 0x7f440c0d2460 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.026+0000 7f4411800640 1 --2- 172.21.15.2:0/3054579233 >> v2:172.21.15.156:3300/0 conn(0x7f440c0d0f80 0x7f440c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.028+0000 7f4412200640 1 --2- 172.21.15.2:0/3054579233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d2460 0x7f440c0b6d00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f440c0d49e0 tx=0x7f43fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64260d3a6c0065f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.028+0000 7f440be00640 1 -- 172.21.15.2:0/3054579233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc037070 con 0x7f440c0d2460 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.028+0000 7f440be00640 1 -- 172.21.15.2:0/3054579233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc032440 con 0x7f440c0d2460 2024-05-14T15:17:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.028+0000 7f440be00640 1 -- 172.21.15.2:0/3054579233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc032810 con 0x7f440c0d2460 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 -- 172.21.15.2:0/3054579233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d2460 msgr2=0x7f440c0b6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 --2- 172.21.15.2:0/3054579233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d2460 0x7f440c0b6d00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f440c0d49e0 tx=0x7f43fc02a1e0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 -- 172.21.15.2:0/3054579233 shutdown_connections 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 --2- 172.21.15.2:0/3054579233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d2460 0x7f440c0b6d00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 --2- 172.21.15.2:0/3054579233 >> v2:172.21.15.156:3300/0 conn(0x7f440c0d0f80 0x7f440c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 -- 172.21.15.2:0/3054579233 >> 172.21.15.2:0/3054579233 conn(0x7f440c08d020 msgr2=0x7f440c08d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 -- 172.21.15.2:0/3054579233 shutdown_connections 2024-05-14T15:17:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.029+0000 7f4412c00640 1 -- 172.21.15.2:0/3054579233 wait complete. 2024-05-14T15:17:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.032+0000 7f4412c00640 1 Processor -- start 2024-05-14T15:17:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.032+0000 7f4412c00640 1 -- start start 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.033+0000 7f4412c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f440c0b41e0 0x7f440c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.033+0000 7f4412c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 0x7f440c0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4412c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f440c156550 0x7f440c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4412c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f440c0b8d70 con 0x7f440c0d0f80 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4412c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f440c0b4f90 con 0x7f440c156550 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4412c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f440c0b8ef0 con 0x7f440c0b41e0 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 0x7f440c0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 0x7f440c0c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58714/0 (socket says 172.21.15.2:58714) 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 -- 172.21.15.2:0/2168983893 learned_addr learned my addr 172.21.15.2:0/2168983893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4411800640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f440c0b41e0 0x7f440c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4412200640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f440c156550 0x7f440c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 -- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f440c0b41e0 msgr2=0x7f440c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f440c0b41e0 0x7f440c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 -- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f440c156550 msgr2=0x7f440c0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f440c156550 0x7f440c0c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4410e00640 1 -- 172.21.15.2:0/2168983893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c0b1850 con 0x7f440c0d0f80 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4412200640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f440c156550 0x7f440c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.034+0000 7f4411800640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f440c0b41e0 0x7f440c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.035+0000 7f4410e00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 0x7f440c0c7690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c3a0 tx=0x7f43f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.035+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f80074e0 con 0x7f440c0d0f80 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.035+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f8007680 con 0x7f440c0d0f80 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.035+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8004a20 con 0x7f440c0d0f80 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.035+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c0b1b30 con 0x7f440c0d0f80 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.035+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c0b20f0 con 0x7f440c0d0f80 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.036+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c050870 con 0x7f440c0d0f80 2024-05-14T15:17:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.038+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43f801a020 con 0x7f440c0d0f80 2024-05-14T15:17:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.039+0000 7f4409600640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43ec076300 0x7f43ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.039+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f43f8096f60 con 0x7f440c0d0f80 2024-05-14T15:17:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.039+0000 7f4411800640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43ec076300 0x7f43ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.041+0000 7f4411800640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43ec076300 0x7f43ec078810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f440c074ef0 tx=0x7f44040074b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.044+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43f8060690 con 0x7f440c0d0f80 2024-05-14T15:17:11.209 INFO:tasks.ceph.mds.a.smithi002.stderr:2024-05-14T15:17:11.210+0000 7f1730200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T15:17:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.315+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f440c0cd770 con 0x7f440c0d0f80 2024-05-14T15:17:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.670+0000 7f4409600640 1 -- 172.21.15.2:0/2168983893 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f43f805ff90 con 0x7f440c0d0f80 2024-05-14T15:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43ec076300 msgr2=0x7f43ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43ec076300 0x7f43ec078810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f440c074ef0 tx=0x7f44040074b0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 msgr2=0x7f440c0c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 0x7f440c0c7690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c3a0 tx=0x7f43f800c860 comp rx=0 tx=0).stop 2024-05-14T15:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 shutdown_connections 2024-05-14T15:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f43ec076300 0x7f43ec078810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f440c156550 0x7f440c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f440c0d0f80 0x7f440c0c7690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 --2- 172.21.15.2:0/2168983893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f440c0b41e0 0x7f440c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 >> 172.21.15.2:0/2168983893 conn(0x7f440c08d020 msgr2=0x7f440c0717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 shutdown_connections 2024-05-14T15:17:11.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.674+0000 7f4412c00640 1 -- 172.21.15.2:0/2168983893 wait complete. 2024-05-14T15:17:11.702 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T15:17:11.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:17:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.979+0000 7f3cf5c00640 1 Processor -- start 2024-05-14T15:17:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.979+0000 7f3cf5c00640 1 -- start start 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3cf5c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3cf006fbd0 0x7f3cf0163af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3cf5c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf0164590 con 0x7f3cf0164030 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3cf5c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf0164870 con 0x7f3cf006de10 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3cf5c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f3cf006f180 con 0x7f3cf006fbd0 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3ce7400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3cf0164030 0x7f3cf006d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41586/0 (socket says 172.21.15.2:41586) 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3ce7400640 1 -- 172.21.15.2:0/752609420 learned_addr learned my addr 172.21.15.2:0/752609420 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:11.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.982+0000 7f3cefe00640 1 --2- 172.21.15.2:0/752609420 >> v2:172.21.15.2:3300/0 conn(0x7f3cf006fbd0 0x7f3cf0163af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.983+0000 7f3cef400640 1 -- 172.21.15.2:0/752609420 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75555845 0 0) 0x7f3cf0164590 con 0x7f3cf0164030 2024-05-14T15:17:11.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.983+0000 7f3cef400640 1 -- 172.21.15.2:0/752609420 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd4003520 con 0x7f3cf0164030 2024-05-14T15:17:11.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.983+0000 7f3cefe00640 1 -- 172.21.15.2:0/752609420 >> v1:172.21.15.156:6789/0 conn(0x7f3cf006de10 legacy=0x7f3cf00af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.983+0000 7f3cefe00640 1 -- 172.21.15.2:0/752609420 >> v1:172.21.15.2:6789/0 conn(0x7f3cf0164030 legacy=0x7f3cf006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.983+0000 7f3cefe00640 1 -- 172.21.15.2:0/752609420 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf006f3d0 con 0x7f3cf006fbd0 2024-05-14T15:17:11.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.985+0000 7f3cefe00640 1 --2- 172.21.15.2:0/752609420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0163af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00097a0 tx=0x7f3ce002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452db6ca63c181f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.985+0000 7f3cef400640 1 -- 172.21.15.2:0/752609420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0037070 con 0x7f3cf006fbd0 2024-05-14T15:17:11.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.985+0000 7f3cef400640 1 -- 172.21.15.2:0/752609420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce0032440 con 0x7f3cf006fbd0 2024-05-14T15:17:11.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.985+0000 7f3cef400640 1 -- 172.21.15.2:0/752609420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce002ae60 con 0x7f3cf006fbd0 2024-05-14T15:17:11.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 -- 172.21.15.2:0/752609420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf006fbd0 msgr2=0x7f3cf0163af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/752609420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0163af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00097a0 tx=0x7f3ce002a110 comp rx=0 tx=0).stop 2024-05-14T15:17:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 -- 172.21.15.2:0/752609420 shutdown_connections 2024-05-14T15:17:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/752609420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0163af0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 -- 172.21.15.2:0/752609420 >> 172.21.15.2:0/752609420 conn(0x7f3cf00732e0 msgr2=0x7f3cf00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 -- 172.21.15.2:0/752609420 shutdown_connections 2024-05-14T15:17:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.986+0000 7f3cf5c00640 1 -- 172.21.15.2:0/752609420 wait complete. 2024-05-14T15:17:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.989+0000 7f3cf5c00640 1 Processor -- start 2024-05-14T15:17:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.989+0000 7f3cf5c00640 1 -- start start 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cf0164030 0x7f3cf0143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 0x7f3cf0162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01601a0 con 0x7f3cf01462d0 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0070f20 con 0x7f3cf006fbd0 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf0160320 con 0x7f3cf0164030 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.990+0000 7f3cf5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 0x7f3cf0162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 0x7f3cf0162240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58748/0 (socket says 172.21.15.2:58748) 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 -- 172.21.15.2:0/3811582565 learned_addr learned my addr 172.21.15.2:0/3811582565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cefe00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3ce7400640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cf0164030 0x7f3cf0143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 -- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cf0164030 msgr2=0x7f3cf0143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cf0164030 0x7f3cf0143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 -- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cf006fbd0 msgr2=0x7f3cf0158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 -- 172.21.15.2:0/3811582565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf01467e0 con 0x7f3cf01462d0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.991+0000 7f3cf5200640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 0x7f3cf0162240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8002230 tx=0x7f3ce800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.992+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8003b70 con 0x7f3cf01462d0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.992+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce8003d10 con 0x7f3cf01462d0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.992+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80052d0 con 0x7f3cf01462d0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.992+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf0146ac0 con 0x7f3cf01462d0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.992+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf0147080 con 0x7f3cf01462d0 2024-05-14T15:17:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.993+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf0050870 con 0x7f3cf01462d0 2024-05-14T15:17:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.995+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ce8005680 con 0x7f3cf01462d0 2024-05-14T15:17:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.996+0000 7f3cecc00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3ccc076300 0x7f3ccc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.997+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3ce8097910 con 0x7f3cf01462d0 2024-05-14T15:17:11.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.997+0000 7f3cefe00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3ccc076300 0x7f3ccc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:11.999+0000 7f3cefe00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3ccc076300 0x7f3ccc078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0034000 tx=0x7f3ce002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.001+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ce8060fb0 con 0x7f3cf01462d0 2024-05-14T15:17:12.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.255+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cf0163860 con 0x7f3cf01462d0 2024-05-14T15:17:12.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.257+0000 7f3cecc00640 1 -- 172.21.15.2:0/3811582565 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f3ce80608b0 con 0x7f3cf01462d0 2024-05-14T15:17:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:12.256 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:17:08.156565+0000","modified":"2024-05-14T15:17:11.317343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.2:6835/3645921439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3645921439},{"type":"v1","addr":"172.21.15.2:6835","nonce":3645921439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4947,"qdb_cluster":[4947]},"id":2}]} 2024-05-14T15:17:12.256 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3ccc076300 msgr2=0x7f3ccc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3ccc076300 0x7f3ccc078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0034000 tx=0x7f3ce002e000 comp rx=0 tx=0).stop 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 msgr2=0x7f3cf0162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 0x7f3cf0162240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8002230 tx=0x7f3ce800cb90 comp rx=0 tx=0).stop 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 shutdown_connections 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3ccc076300 0x7f3ccc078810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf01462d0 0x7f3cf0162240 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cf0164030 0x7f3cf0143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 --2- 172.21.15.2:0/3811582565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cf006fbd0 0x7f3cf0158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 >> 172.21.15.2:0/3811582565 conn(0x7f3cf00732e0 msgr2=0x7f3cf00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:12.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 shutdown_connections 2024-05-14T15:17:12.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.260+0000 7f3cf5c00640 1 -- 172.21.15.2:0/3811582565 wait complete. 2024-05-14T15:17:12.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:17:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.573+0000 7f42a4a00640 1 Processor -- start 2024-05-14T15:17:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.574+0000 7f42a4a00640 1 -- start start 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f42a4a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42a006feb0 0x7f42a0160900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f42a4a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a0070c90 con 0x7f42a00b6340 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f42a4a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a00b6820 con 0x7f42a006d700 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f42a4a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f42a0074510 con 0x7f42a006feb0 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f429e800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f42a00b6340 0x7f42a0073e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41588/0 (socket says 172.21.15.2:41588) 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f429e800640 1 -- 172.21.15.2:0/2081693506 learned_addr learned my addr 172.21.15.2:0/2081693506 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.576+0000 7f4295e00640 1 --2- 172.21.15.2:0/2081693506 >> v2:172.21.15.2:3300/0 conn(0x7f42a006feb0 0x7f42a0160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.577+0000 7f429de00640 1 -- 172.21.15.2:0/2081693506 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213935492 0 0) 0x7f4290001110 con 0x7f42a00b6340 2024-05-14T15:17:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.577+0000 7f429de00640 1 -- 172.21.15.2:0/2081693506 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4284005730 con 0x7f42a00b6340 2024-05-14T15:17:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.577+0000 7f4295e00640 1 -- 172.21.15.2:0/2081693506 >> v1:172.21.15.156:6789/0 conn(0x7f42a006d700 legacy=0x7f42a006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.577+0000 7f4295e00640 1 -- 172.21.15.2:0/2081693506 >> v1:172.21.15.2:6789/0 conn(0x7f42a00b6340 legacy=0x7f42a0073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.577+0000 7f4295e00640 1 -- 172.21.15.2:0/2081693506 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a006f3d0 con 0x7f42a006feb0 2024-05-14T15:17:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.578+0000 7f4295e00640 1 --2- 172.21.15.2:0/2081693506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006feb0 0x7f42a0160900 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f42880097a0 tx=0x7f428802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60288d630c14327f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.578+0000 7f429de00640 1 -- 172.21.15.2:0/2081693506 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288037070 con 0x7f42a006feb0 2024-05-14T15:17:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.578+0000 7f429de00640 1 -- 172.21.15.2:0/2081693506 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4288032440 con 0x7f42a006feb0 2024-05-14T15:17:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.578+0000 7f429de00640 1 -- 172.21.15.2:0/2081693506 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288032810 con 0x7f42a006feb0 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.579+0000 7f42a4a00640 1 -- 172.21.15.2:0/2081693506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006feb0 msgr2=0x7f42a0160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.579+0000 7f42a4a00640 1 --2- 172.21.15.2:0/2081693506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006feb0 0x7f42a0160900 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f42880097a0 tx=0x7f428802a180 comp rx=0 tx=0).stop 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.579+0000 7f42a4a00640 1 -- 172.21.15.2:0/2081693506 shutdown_connections 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.579+0000 7f42a4a00640 1 --2- 172.21.15.2:0/2081693506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006feb0 0x7f42a0160900 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.580+0000 7f42a4a00640 1 -- 172.21.15.2:0/2081693506 >> 172.21.15.2:0/2081693506 conn(0x7f42a00732e0 msgr2=0x7f42a00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.580+0000 7f42a4a00640 1 -- 172.21.15.2:0/2081693506 shutdown_connections 2024-05-14T15:17:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.580+0000 7f42a4a00640 1 -- 172.21.15.2:0/2081693506 wait complete. 2024-05-14T15:17:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.582+0000 7f42a4a00640 1 Processor -- start 2024-05-14T15:17:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.582+0000 7f42a4a00640 1 -- start start 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f42a4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 0x7f42a0147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f42a4a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006feb0 0x7f42a01e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f42a4a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a00b6340 0x7f42a0156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f42a4a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42a006f180 con 0x7f42a006d700 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f42a4a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f42a0160e40 con 0x7f42a00b6340 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f42a4a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f42a006fa20 con 0x7f42a006feb0 2024-05-14T15:17:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f429e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 0x7f42a0147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:12.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f429e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 0x7f42a0147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58766/0 (socket says 172.21.15.2:58766) 2024-05-14T15:17:12.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.584+0000 7f429e800640 1 -- 172.21.15.2:0/1986044901 learned_addr learned my addr 172.21.15.2:0/1986044901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f4295e00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006feb0 0x7f42a01e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f429e800640 1 -- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006feb0 msgr2=0x7f42a01e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f429e800640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006feb0 0x7f42a01e7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f429e800640 1 -- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a00b6340 msgr2=0x7f42a0156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f429f200640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a00b6340 0x7f42a0156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f429e800640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a00b6340 0x7f42a0156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.585+0000 7f429e800640 1 -- 172.21.15.2:0/1986044901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a015e520 con 0x7f42a006d700 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.586+0000 7f429e800640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 0x7f42a0147130 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f429000c730 tx=0x7f429000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.586+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290005ab0 con 0x7f42a006d700 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.586+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4290001d30 con 0x7f42a006d700 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.586+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a015e800 con 0x7f42a006d700 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.586+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290005e50 con 0x7f42a006d700 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.586+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a01ea870 con 0x7f42a006d700 2024-05-14T15:17:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.587+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a0050870 con 0x7f42a006d700 2024-05-14T15:17:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.588+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4290007070 con 0x7f42a006d700 2024-05-14T15:17:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.590+0000 7f4297400640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f427c0764a0 0x7f427c0789b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.590+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4290097440 con 0x7f42a006d700 2024-05-14T15:17:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.591+0000 7f4295e00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f427c0764a0 0x7f427c0789b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.592+0000 7f4295e00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f427c0764a0 0x7f427c0789b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4288034000 tx=0x7f428802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.595+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42a0070c90 con 0x7f42a006d700 2024-05-14T15:17:12.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.808+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a00b6120 con 0x7f42a006d700 2024-05-14T15:17:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.812+0000 7f4297400640 1 -- 172.21.15.2:0/1986044901 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16870 (secure 0 0 0) 0x7f4290060ae0 con 0x7f42a006d700 2024-05-14T15:17:12.811 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:12.811 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":40,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:17:09.627702+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:17:05.637911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T15:17:07.143749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.814+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f427c0764a0 msgr2=0x7f427c0789b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.814+0000 7f42a4a00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f427c0764a0 0x7f427c0789b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4288034000 tx=0x7f428802e000 comp rx=0 tx=0).stop 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 msgr2=0x7f42a0147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 0x7f42a0147130 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f429000c730 tx=0x7f429000cbf0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 shutdown_connections 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f427c0764a0 0x7f427c0789b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a00b6340 0x7f42a0156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006feb0 0x7f42a01e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 --2- 172.21.15.2:0/1986044901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42a006d700 0x7f42a0147130 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 >> 172.21.15.2:0/1986044901 conn(0x7f42a00732e0 msgr2=0x7f42a015fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 shutdown_connections 2024-05-14T15:17:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:12.815+0000 7f42a4a00640 1 -- 172.21.15.2:0/1986044901 wait complete. 2024-05-14T15:17:12.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T15:17:12.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:17:13.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.118+0000 7fd48ac00640 1 Processor -- start 2024-05-14T15:17:13.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.118+0000 7fd48ac00640 1 -- start start 2024-05-14T15:17:13.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.120+0000 7fd48ac00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4840b64e0 0x7fd48415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.120+0000 7fd48ac00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4840b5ab0 con 0x7fd4840b56a0 2024-05-14T15:17:13.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.121+0000 7fd48ac00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4840b0d10 con 0x7fd48406d700 2024-05-14T15:17:13.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.121+0000 7fd48ac00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd48415cfc0 con 0x7fd4840b64e0 2024-05-14T15:17:13.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.121+0000 7fd489800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd4840b56a0 0x7fd4840b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41602/0 (socket says 172.21.15.2:41602) 2024-05-14T15:17:13.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.121+0000 7fd489800640 1 -- 172.21.15.2:0/887010241 learned_addr learned my addr 172.21.15.2:0/887010241 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:13.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.121+0000 7fd488e00640 1 --2- 172.21.15.2:0/887010241 >> v2:172.21.15.2:3300/0 conn(0x7fd4840b64e0 0x7fd48415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.121+0000 7fd488e00640 1 -- 172.21.15.2:0/887010241 >> v1:172.21.15.156:6789/0 conn(0x7fd48406d700 legacy=0x7fd48406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:13.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.122+0000 7fd488e00640 1 -- 172.21.15.2:0/887010241 >> v1:172.21.15.2:6789/0 conn(0x7fd4840b56a0 legacy=0x7fd4840b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.122+0000 7fd488e00640 1 -- 172.21.15.2:0/887010241 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840b0ff0 con 0x7fd4840b64e0 2024-05-14T15:17:13.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.122+0000 7fd483e00640 1 -- 172.21.15.2:0/887010241 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401997821 0 0) 0x7fd478001110 con 0x7fd4840b56a0 2024-05-14T15:17:13.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.123+0000 7fd488e00640 1 --2- 172.21.15.2:0/887010241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48415ca80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4700097a0 tx=0x7fd47002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53088bfd604e09c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:13.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.123+0000 7fd483e00640 1 -- 172.21.15.2:0/887010241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470037070 con 0x7fd4840b64e0 2024-05-14T15:17:13.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.123+0000 7fd483e00640 1 -- 172.21.15.2:0/887010241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd470032440 con 0x7fd4840b64e0 2024-05-14T15:17:13.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.123+0000 7fd483e00640 1 -- 172.21.15.2:0/887010241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470032810 con 0x7fd4840b64e0 2024-05-14T15:17:13.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 -- 172.21.15.2:0/887010241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 msgr2=0x7fd48415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 --2- 172.21.15.2:0/887010241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48415ca80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4700097a0 tx=0x7fd47002a180 comp rx=0 tx=0).stop 2024-05-14T15:17:13.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 -- 172.21.15.2:0/887010241 shutdown_connections 2024-05-14T15:17:13.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 --2- 172.21.15.2:0/887010241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48415ca80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 -- 172.21.15.2:0/887010241 >> 172.21.15.2:0/887010241 conn(0x7fd4840732e0 msgr2=0x7fd4840736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:13.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 -- 172.21.15.2:0/887010241 shutdown_connections 2024-05-14T15:17:13.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.124+0000 7fd48ac00640 1 -- 172.21.15.2:0/887010241 wait complete. 2024-05-14T15:17:13.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.126+0000 7fd48ac00640 1 Processor -- start 2024-05-14T15:17:13.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.127+0000 7fd48ac00640 1 -- start start 2024-05-14T15:17:13.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48ac00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48406d700 0x7fd484159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48ac00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4840b56a0 0x7fd48414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48ac00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48ac00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840b68f0 con 0x7fd4840b64e0 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48ac00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840b5180 con 0x7fd4840b56a0 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48ac00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd4841606c0 con 0x7fd48406d700 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.128+0000 7fd48a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48414a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58784/0 (socket says 172.21.15.2:58784) 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 -- 172.21.15.2:0/875029027 learned_addr learned my addr 172.21.15.2:0/875029027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd488e00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4840b56a0 0x7fd48414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd489800640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48406d700 0x7fd484159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 -- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48406d700 msgr2=0x7fd484159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48406d700 0x7fd484159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 -- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4840b56a0 msgr2=0x7fd48414a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4840b56a0 0x7fd48414a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 -- 172.21.15.2:0/875029027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840c6780 con 0x7fd4840b64e0 2024-05-14T15:17:13.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.129+0000 7fd48a200640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48414a6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00b9e0 tx=0x7fd47c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.130+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c003b70 con 0x7fd4840b64e0 2024-05-14T15:17:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.130+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c003d10 con 0x7fd4840b64e0 2024-05-14T15:17:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.130+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00cb60 con 0x7fd4840b64e0 2024-05-14T15:17:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.130+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4840c6a60 con 0x7fd4840b64e0 2024-05-14T15:17:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.130+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd484148500 con 0x7fd4840b64e0 2024-05-14T15:17:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.131+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484050870 con 0x7fd4840b64e0 2024-05-14T15:17:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.132+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd47c00cd00 con 0x7fd4840b64e0 2024-05-14T15:17:13.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.133+0000 7fd481600640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd464076300 0x7fd464078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.133+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd47c097560 con 0x7fd4840b64e0 2024-05-14T15:17:13.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.134+0000 7fd489800640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd464076300 0x7fd464078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.135+0000 7fd489800640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd464076300 0x7fd464078810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd478000f60 tx=0x7fd478007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.138+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd47c060d30 con 0x7fd4840b64e0 2024-05-14T15:17:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.341+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4840d0da0 con 0x7fd464076300 2024-05-14T15:17:13.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.362+0000 7fd481600640 1 -- 172.21.15.2:0/875029027 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7fd4840d0da0 con 0x7fd464076300 2024-05-14T15:17:13.365 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:13.366 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd464076300 msgr2=0x7fd464078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd464076300 0x7fd464078810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd478000f60 tx=0x7fd478007c00 comp rx=0 tx=0).stop 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 msgr2=0x7fd48414a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48414a6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00b9e0 tx=0x7fd47c00bea0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 shutdown_connections 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd464076300 0x7fd464078810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4840b56a0 0x7fd48414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4840b64e0 0x7fd48414a6f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 --2- 172.21.15.2:0/875029027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48406d700 0x7fd484159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.368+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 >> 172.21.15.2:0/875029027 conn(0x7fd4840732e0 msgr2=0x7fd4840b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.369+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 shutdown_connections 2024-05-14T15:17:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.369+0000 7fd48ac00640 1 -- 172.21.15.2:0/875029027 wait complete. 2024-05-14T15:17:13.396 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-05-14T15:17:12.882555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254260,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720460,"statfs":{"total":773094113280,"available":772833751040,"internally_reserved":0,"allocated":4890624,"data_stored":2741572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001859"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.644048+0000","last_change":"2024-05-14T15:17:08.643493+0000","last_active":"2024-05-14T15:17:09.644048+0000","last_peered":"2024-05-14T15:17:09.644048+0000","last_clean":"2024-05-14T15:17:09.644048+0000","last_became_active":"2024-05-14T15:17:08.643148+0000","last_became_peered":"2024-05-14T15:17:08.643148+0000","last_unstale":"2024-05-14T15:17:09.644048+0000","last_undegraded":"2024-05-14T15:17:09.644048+0000","last_fullsized":"2024-05-14T15:17:09.644048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:03:34.016906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103363+0000","last_change":"2024-05-14T15:17:08.654500+0000","last_active":"2024-05-14T15:17:10.103363+0000","last_peered":"2024-05-14T15:17:10.103363+0000","last_clean":"2024-05-14T15:17:10.103363+0000","last_became_active":"2024-05-14T15:17:08.654209+0000","last_became_peered":"2024-05-14T15:17:08.654209+0000","last_unstale":"2024-05-14T15:17:10.103363+0000","last_undegraded":"2024-05-14T15:17:10.103363+0000","last_fullsized":"2024-05-14T15:17:10.103363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:12:08.191422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643547+0000","last_change":"2024-05-14T15:17:08.646982+0000","last_active":"2024-05-14T15:17:09.643547+0000","last_peered":"2024-05-14T15:17:09.643547+0000","last_clean":"2024-05-14T15:17:09.643547+0000","last_became_active":"2024-05-14T15:17:08.645840+0000","last_became_peered":"2024-05-14T15:17:08.645840+0000","last_unstale":"2024-05-14T15:17:09.643547+0000","last_undegraded":"2024-05-14T15:17:09.643547+0000","last_fullsized":"2024-05-14T15:17:09.643547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:50:10.466423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643109+0000","last_change":"2024-05-14T15:17:08.657277+0000","last_active":"2024-05-14T15:17:09.643109+0000","last_peered":"2024-05-14T15:17:09.643109+0000","last_clean":"2024-05-14T15:17:09.643109+0000","last_became_active":"2024-05-14T15:17:08.656888+0000","last_became_peered":"2024-05-14T15:17:08.656888+0000","last_unstale":"2024-05-14T15:17:09.643109+0000","last_undegraded":"2024-05-14T15:17:09.643109+0000","last_fullsized":"2024-05-14T15:17:09.643109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:30.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102664+0000","last_change":"2024-05-14T15:17:08.653927+0000","last_active":"2024-05-14T15:17:10.102664+0000","last_peered":"2024-05-14T15:17:10.102664+0000","last_clean":"2024-05-14T15:17:10.102664+0000","last_became_active":"2024-05-14T15:17:08.653674+0000","last_became_peered":"2024-05-14T15:17:08.653674+0000","last_unstale":"2024-05-14T15:17:10.102664+0000","last_undegraded":"2024-05-14T15:17:10.102664+0000","last_fullsized":"2024-05-14T15:17:10.102664+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:14:55.308844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102517+0000","last_change":"2024-05-14T15:17:08.635281+0000","last_active":"2024-05-14T15:17:10.102517+0000","last_peered":"2024-05-14T15:17:10.102517+0000","last_clean":"2024-05-14T15:17:10.102517+0000","last_became_active":"2024-05-14T15:17:08.634930+0000","last_became_peered":"2024-05-14T15:17:08.634930+0000","last_unstale":"2024-05-14T15:17:10.102517+0000","last_undegraded":"2024-05-14T15:17:10.102517+0000","last_fullsized":"2024-05-14T15:17:10.102517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:03.770193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103163+0000","last_change":"2024-05-14T15:17:08.657897+0000","last_active":"2024-05-14T15:17:10.103163+0000","last_peered":"2024-05-14T15:17:10.103163+0000","last_clean":"2024-05-14T15:17:10.103163+0000","last_became_active":"2024-05-14T15:17:08.646667+0000","last_became_peered":"2024-05-14T15:17:08.646667+0000","last_unstale":"2024-05-14T15:17:10.103163+0000","last_undegraded":"2024-05-14T15:17:10.103163+0000","last_fullsized":"2024-05-14T15:17:10.103163+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:11.051597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640321+0000","last_change":"2024-05-14T15:17:08.660999+0000","last_active":"2024-05-14T15:17:09.640321+0000","last_peered":"2024-05-14T15:17:09.640321+0000","last_clean":"2024-05-14T15:17:09.640321+0000","last_became_active":"2024-05-14T15:17:08.660666+0000","last_became_peered":"2024-05-14T15:17:08.660666+0000","last_unstale":"2024-05-14T15:17:09.640321+0000","last_undegraded":"2024-05-14T15:17:09.640321+0000","last_fullsized":"2024-05-14T15:17:09.640321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:56.225720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104162+0000","last_change":"2024-05-14T15:17:08.656945+0000","last_active":"2024-05-14T15:17:10.104162+0000","last_peered":"2024-05-14T15:17:10.104162+0000","last_clean":"2024-05-14T15:17:10.104162+0000","last_became_active":"2024-05-14T15:17:08.656058+0000","last_became_peered":"2024-05-14T15:17:08.656058+0000","last_unstale":"2024-05-14T15:17:10.104162+0000","last_undegraded":"2024-05-14T15:17:10.104162+0000","last_fullsized":"2024-05-14T15:17:10.104162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:11.051597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104649+0000","last_change":"2024-05-14T15:17:08.661455+0000","last_active":"2024-05-14T15:17:10.104649+0000","last_peered":"2024-05-14T15:17:10.104649+0000","last_clean":"2024-05-14T15:17:10.104649+0000","last_became_active":"2024-05-14T15:17:08.661232+0000","last_became_peered":"2024-05-14T15:17:08.661232+0000","last_unstale":"2024-05-14T15:17:10.104649+0000","last_undegraded":"2024-05-14T15:17:10.104649+0000","last_fullsized":"2024-05-14T15:17:10.104649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:11:15.180771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.106239+0000","last_change":"2024-05-14T15:17:08.662640+0000","last_active":"2024-05-14T15:17:10.106239+0000","last_peered":"2024-05-14T15:17:10.106239+0000","last_clean":"2024-05-14T15:17:10.106239+0000","last_became_active":"2024-05-14T15:17:08.662015+0000","last_became_peered":"2024-05-14T15:17:08.662015+0000","last_unstale":"2024-05-14T15:17:10.106239+0000","last_undegraded":"2024-05-14T15:17:10.106239+0000","last_fullsized":"2024-05-14T15:17:10.106239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:55:35.430804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102662+0000","last_change":"2024-05-14T15:17:08.653825+0000","last_active":"2024-05-14T15:17:10.102662+0000","last_peered":"2024-05-14T15:17:10.102662+0000","last_clean":"2024-05-14T15:17:10.102662+0000","last_became_active":"2024-05-14T15:17:08.653495+0000","last_became_peered":"2024-05-14T15:17:08.653495+0000","last_unstale":"2024-05-14T15:17:10.102662+0000","last_undegraded":"2024-05-14T15:17:10.102662+0000","last_fullsized":"2024-05-14T15:17:10.102662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:30:06.095313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104021+0000","last_change":"2024-05-14T15:17:08.648038+0000","last_active":"2024-05-14T15:17:10.104021+0000","last_peered":"2024-05-14T15:17:10.104021+0000","last_clean":"2024-05-14T15:17:10.104021+0000","last_became_active":"2024-05-14T15:17:08.641958+0000","last_became_peered":"2024-05-14T15:17:08.641958+0000","last_unstale":"2024-05-14T15:17:10.104021+0000","last_undegraded":"2024-05-14T15:17:10.104021+0000","last_fullsized":"2024-05-14T15:17:10.104021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:24:57.017491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101294+0000","last_change":"2024-05-14T15:17:08.657379+0000","last_active":"2024-05-14T15:17:10.101294+0000","last_peered":"2024-05-14T15:17:10.101294+0000","last_clean":"2024-05-14T15:17:10.101294+0000","last_became_active":"2024-05-14T15:17:08.657034+0000","last_became_peered":"2024-05-14T15:17:08.657034+0000","last_unstale":"2024-05-14T15:17:10.101294+0000","last_undegraded":"2024-05-14T15:17:10.101294+0000","last_fullsized":"2024-05-14T15:17:10.101294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:11.051597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637199+0000","last_change":"2024-05-14T15:17:08.648283+0000","last_active":"2024-05-14T15:17:09.637199+0000","last_peered":"2024-05-14T15:17:09.637199+0000","last_clean":"2024-05-14T15:17:09.637199+0000","last_became_active":"2024-05-14T15:17:08.647923+0000","last_became_peered":"2024-05-14T15:17:08.647923+0000","last_unstale":"2024-05-14T15:17:09.637199+0000","last_undegraded":"2024-05-14T15:17:09.637199+0000","last_fullsized":"2024-05-14T15:17:09.637199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:28:35.937658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102317+0000","last_change":"2024-05-14T15:17:08.653672+0000","last_active":"2024-05-14T15:17:10.102317+0000","last_peered":"2024-05-14T15:17:10.102317+0000","last_clean":"2024-05-14T15:17:10.102317+0000","last_became_active":"2024-05-14T15:17:08.653390+0000","last_became_peered":"2024-05-14T15:17:08.653390+0000","last_unstale":"2024-05-14T15:17:10.102317+0000","last_undegraded":"2024-05-14T15:17:10.102317+0000","last_fullsized":"2024-05-14T15:17:10.102317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:14:55.308844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638991+0000","last_change":"2024-05-14T15:17:08.655118+0000","last_active":"2024-05-14T15:17:09.638991+0000","last_peered":"2024-05-14T15:17:09.638991+0000","last_clean":"2024-05-14T15:17:09.638991+0000","last_became_active":"2024-05-14T15:17:08.653462+0000","last_became_peered":"2024-05-14T15:17:08.653462+0000","last_unstale":"2024-05-14T15:17:09.638991+0000","last_undegraded":"2024-05-14T15:17:09.638991+0000","last_fullsized":"2024-05-14T15:17:09.638991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:08:17.087333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639393+0000","last_change":"2024-05-14T15:17:08.653265+0000","last_active":"2024-05-14T15:17:09.639393+0000","last_peered":"2024-05-14T15:17:09.639393+0000","last_clean":"2024-05-14T15:17:09.639393+0000","last_became_active":"2024-05-14T15:17:08.652466+0000","last_became_peered":"2024-05-14T15:17:08.652466+0000","last_unstale":"2024-05-14T15:17:09.639393+0000","last_undegraded":"2024-05-14T15:17:09.639393+0000","last_fullsized":"2024-05-14T15:17:09.639393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:16:44.349235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641647+0000","last_change":"2024-05-14T15:17:08.647147+0000","last_active":"2024-05-14T15:17:09.641647+0000","last_peered":"2024-05-14T15:17:09.641647+0000","last_clean":"2024-05-14T15:17:09.641647+0000","last_became_active":"2024-05-14T15:17:08.645346+0000","last_became_peered":"2024-05-14T15:17:08.645346+0000","last_unstale":"2024-05-14T15:17:09.641647+0000","last_undegraded":"2024-05-14T15:17:09.641647+0000","last_fullsized":"2024-05-14T15:17:09.641647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:20.337437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105631+0000","last_change":"2024-05-14T15:17:08.650198+0000","last_active":"2024-05-14T15:17:10.105631+0000","last_peered":"2024-05-14T15:17:10.105631+0000","last_clean":"2024-05-14T15:17:10.105631+0000","last_became_active":"2024-05-14T15:17:08.645447+0000","last_became_peered":"2024-05-14T15:17:08.645447+0000","last_unstale":"2024-05-14T15:17:10.105631+0000","last_undegraded":"2024-05-14T15:17:10.105631+0000","last_fullsized":"2024-05-14T15:17:10.105631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:03.804373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105414+0000","last_change":"2024-05-14T15:17:08.653078+0000","last_active":"2024-05-14T15:17:10.105414+0000","last_peered":"2024-05-14T15:17:10.105414+0000","last_clean":"2024-05-14T15:17:10.105414+0000","last_became_active":"2024-05-14T15:17:08.652749+0000","last_became_peered":"2024-05-14T15:17:08.652749+0000","last_unstale":"2024-05-14T15:17:10.105414+0000","last_undegraded":"2024-05-14T15:17:10.105414+0000","last_fullsized":"2024-05-14T15:17:10.105414+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:20.337437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105031+0000","last_change":"2024-05-14T15:17:08.631704+0000","last_active":"2024-05-14T15:17:10.105031+0000","last_peered":"2024-05-14T15:17:10.105031+0000","last_clean":"2024-05-14T15:17:10.105031+0000","last_became_active":"2024-05-14T15:17:08.631326+0000","last_became_peered":"2024-05-14T15:17:08.631326+0000","last_unstale":"2024-05-14T15:17:10.105031+0000","last_undegraded":"2024-05-14T15:17:10.105031+0000","last_fullsized":"2024-05-14T15:17:10.105031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:31:21.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637050+0000","last_change":"2024-05-14T15:17:08.642316+0000","last_active":"2024-05-14T15:17:09.637050+0000","last_peered":"2024-05-14T15:17:09.637050+0000","last_clean":"2024-05-14T15:17:09.637050+0000","last_became_active":"2024-05-14T15:17:08.641774+0000","last_became_peered":"2024-05-14T15:17:08.641774+0000","last_unstale":"2024-05-14T15:17:09.637050+0000","last_undegraded":"2024-05-14T15:17:09.637050+0000","last_fullsized":"2024-05-14T15:17:09.637050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:00.843505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640838+0000","last_change":"2024-05-14T15:17:08.642606+0000","last_active":"2024-05-14T15:17:09.640838+0000","last_peered":"2024-05-14T15:17:09.640838+0000","last_clean":"2024-05-14T15:17:09.640838+0000","last_became_active":"2024-05-14T15:17:08.642205+0000","last_became_peered":"2024-05-14T15:17:08.642205+0000","last_unstale":"2024-05-14T15:17:09.640838+0000","last_undegraded":"2024-05-14T15:17:09.640838+0000","last_fullsized":"2024-05-14T15:17:09.640838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:43:48.024255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103357+0000","last_change":"2024-05-14T15:17:08.630763+0000","last_active":"2024-05-14T15:17:10.103357+0000","last_peered":"2024-05-14T15:17:10.103357+0000","last_clean":"2024-05-14T15:17:10.103357+0000","last_became_active":"2024-05-14T15:17:08.630442+0000","last_became_peered":"2024-05-14T15:17:08.630442+0000","last_unstale":"2024-05-14T15:17:10.103357+0000","last_undegraded":"2024-05-14T15:17:10.103357+0000","last_fullsized":"2024-05-14T15:17:10.103357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:24:57.017491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643620+0000","last_change":"2024-05-14T15:17:08.658567+0000","last_active":"2024-05-14T15:17:09.643620+0000","last_peered":"2024-05-14T15:17:09.643620+0000","last_clean":"2024-05-14T15:17:09.643620+0000","last_became_active":"2024-05-14T15:17:08.658203+0000","last_became_peered":"2024-05-14T15:17:08.658203+0000","last_unstale":"2024-05-14T15:17:09.643620+0000","last_undegraded":"2024-05-14T15:17:09.643620+0000","last_fullsized":"2024-05-14T15:17:09.643620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:39.935648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.106111+0000","last_change":"2024-05-14T15:17:08.637491+0000","last_active":"2024-05-14T15:17:10.106111+0000","last_peered":"2024-05-14T15:17:10.106111+0000","last_clean":"2024-05-14T15:17:10.106111+0000","last_became_active":"2024-05-14T15:17:08.637158+0000","last_became_peered":"2024-05-14T15:17:08.637158+0000","last_unstale":"2024-05-14T15:17:10.106111+0000","last_undegraded":"2024-05-14T15:17:10.106111+0000","last_fullsized":"2024-05-14T15:17:10.106111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:30:17.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104248+0000","last_change":"2024-05-14T15:17:08.654866+0000","last_active":"2024-05-14T15:17:10.104248+0000","last_peered":"2024-05-14T15:17:10.104248+0000","last_clean":"2024-05-14T15:17:10.104248+0000","last_became_active":"2024-05-14T15:17:08.654517+0000","last_became_peered":"2024-05-14T15:17:08.654517+0000","last_unstale":"2024-05-14T15:17:10.104248+0000","last_undegraded":"2024-05-14T15:17:10.104248+0000","last_fullsized":"2024-05-14T15:17:10.104248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:27:46.422523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637973+0000","last_change":"2024-05-14T15:17:08.643450+0000","last_active":"2024-05-14T15:17:09.637973+0000","last_peered":"2024-05-14T15:17:09.637973+0000","last_clean":"2024-05-14T15:17:09.637973+0000","last_became_active":"2024-05-14T15:17:08.643101+0000","last_became_peered":"2024-05-14T15:17:08.643101+0000","last_unstale":"2024-05-14T15:17:09.637973+0000","last_undegraded":"2024-05-14T15:17:09.637973+0000","last_fullsized":"2024-05-14T15:17:09.637973+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:36.558191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638099+0000","last_change":"2024-05-14T15:17:08.649250+0000","last_active":"2024-05-14T15:17:09.638099+0000","last_peered":"2024-05-14T15:17:09.638099+0000","last_clean":"2024-05-14T15:17:09.638099+0000","last_became_active":"2024-05-14T15:17:08.648958+0000","last_became_peered":"2024-05-14T15:17:08.648958+0000","last_unstale":"2024-05-14T15:17:09.638099+0000","last_undegraded":"2024-05-14T15:17:09.638099+0000","last_fullsized":"2024-05-14T15:17:09.638099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:04:24.936924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102730+0000","last_change":"2024-05-14T15:17:08.644705+0000","last_active":"2024-05-14T15:17:10.102730+0000","last_peered":"2024-05-14T15:17:10.102730+0000","last_clean":"2024-05-14T15:17:10.102730+0000","last_became_active":"2024-05-14T15:17:08.644408+0000","last_became_peered":"2024-05-14T15:17:08.644408+0000","last_unstale":"2024-05-14T15:17:10.102730+0000","last_undegraded":"2024-05-14T15:17:10.102730+0000","last_fullsized":"2024-05-14T15:17:10.102730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:09:06.196387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641293+0000","last_change":"2024-05-14T15:17:08.651771+0000","last_active":"2024-05-14T15:17:09.641293+0000","last_peered":"2024-05-14T15:17:09.641293+0000","last_clean":"2024-05-14T15:17:09.641293+0000","last_became_active":"2024-05-14T15:17:08.651447+0000","last_became_peered":"2024-05-14T15:17:08.651447+0000","last_unstale":"2024-05-14T15:17:09.641293+0000","last_undegraded":"2024-05-14T15:17:09.641293+0000","last_fullsized":"2024-05-14T15:17:09.641293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:01:17.311128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639035+0000","last_change":"2024-05-14T15:17:08.654014+0000","last_active":"2024-05-14T15:17:09.639035+0000","last_peered":"2024-05-14T15:17:09.639035+0000","last_clean":"2024-05-14T15:17:09.639035+0000","last_became_active":"2024-05-14T15:17:08.648263+0000","last_became_peered":"2024-05-14T15:17:08.648263+0000","last_unstale":"2024-05-14T15:17:09.639035+0000","last_undegraded":"2024-05-14T15:17:09.639035+0000","last_fullsized":"2024-05-14T15:17:09.639035+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:29.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103356+0000","last_change":"2024-05-14T15:17:07.605019+0000","last_active":"2024-05-14T15:17:10.103356+0000","last_peered":"2024-05-14T15:17:10.103356+0000","last_clean":"2024-05-14T15:17:10.103356+0000","last_became_active":"2024-05-14T15:17:07.604634+0000","last_became_peered":"2024-05-14T15:17:07.604634+0000","last_unstale":"2024-05-14T15:17:10.103356+0000","last_undegraded":"2024-05-14T15:17:10.103356+0000","last_fullsized":"2024-05-14T15:17:10.103356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:30:05.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101751+0000","last_change":"2024-05-14T15:17:08.646560+0000","last_active":"2024-05-14T15:17:10.101751+0000","last_peered":"2024-05-14T15:17:10.101751+0000","last_clean":"2024-05-14T15:17:10.101751+0000","last_became_active":"2024-05-14T15:17:08.645839+0000","last_became_peered":"2024-05-14T15:17:08.645839+0000","last_unstale":"2024-05-14T15:17:10.101751+0000","last_undegraded":"2024-05-14T15:17:10.101751+0000","last_fullsized":"2024-05-14T15:17:10.101751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:27:02.995737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103179+0000","last_change":"2024-05-14T15:17:07.619947+0000","last_active":"2024-05-14T15:17:10.103179+0000","last_peered":"2024-05-14T15:17:10.103179+0000","last_clean":"2024-05-14T15:17:10.103179+0000","last_became_active":"2024-05-14T15:17:07.619620+0000","last_became_peered":"2024-05-14T15:17:07.619620+0000","last_unstale":"2024-05-14T15:17:10.103179+0000","last_undegraded":"2024-05-14T15:17:10.103179+0000","last_fullsized":"2024-05-14T15:17:10.103179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:30:05.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639507+0000","last_change":"2024-05-14T15:17:08.652959+0000","last_active":"2024-05-14T15:17:09.639507+0000","last_peered":"2024-05-14T15:17:09.639507+0000","last_clean":"2024-05-14T15:17:09.639507+0000","last_became_active":"2024-05-14T15:17:08.652027+0000","last_became_peered":"2024-05-14T15:17:08.652027+0000","last_unstale":"2024-05-14T15:17:09.639507+0000","last_undegraded":"2024-05-14T15:17:09.639507+0000","last_fullsized":"2024-05-14T15:17:09.639507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:46.108541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.644187+0000","last_change":"2024-05-14T15:17:07.621366+0000","last_active":"2024-05-14T15:17:09.644187+0000","last_peered":"2024-05-14T15:17:09.644187+0000","last_clean":"2024-05-14T15:17:09.644187+0000","last_became_active":"2024-05-14T15:17:07.621050+0000","last_became_peered":"2024-05-14T15:17:07.621050+0000","last_unstale":"2024-05-14T15:17:09.644187+0000","last_undegraded":"2024-05-14T15:17:09.644187+0000","last_fullsized":"2024-05-14T15:17:09.644187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:03:24.803952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102570+0000","last_change":"2024-05-14T15:17:08.649247+0000","last_active":"2024-05-14T15:17:10.102570+0000","last_peered":"2024-05-14T15:17:10.102570+0000","last_clean":"2024-05-14T15:17:10.102570+0000","last_became_active":"2024-05-14T15:17:08.645433+0000","last_became_peered":"2024-05-14T15:17:08.645433+0000","last_unstale":"2024-05-14T15:17:10.102570+0000","last_undegraded":"2024-05-14T15:17:10.102570+0000","last_fullsized":"2024-05-14T15:17:10.102570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:20.337437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104196+0000","last_change":"2024-05-14T15:17:07.603097+0000","last_active":"2024-05-14T15:17:10.104196+0000","last_peered":"2024-05-14T15:17:10.104196+0000","last_clean":"2024-05-14T15:17:10.104196+0000","last_became_active":"2024-05-14T15:17:07.602732+0000","last_became_peered":"2024-05-14T15:17:07.602732+0000","last_unstale":"2024-05-14T15:17:10.104196+0000","last_undegraded":"2024-05-14T15:17:10.104196+0000","last_fullsized":"2024-05-14T15:17:10.104196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:14.267105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641944+0000","last_change":"2024-05-14T15:17:08.641813+0000","last_active":"2024-05-14T15:17:09.641944+0000","last_peered":"2024-05-14T15:17:09.641944+0000","last_clean":"2024-05-14T15:17:09.641944+0000","last_became_active":"2024-05-14T15:17:08.641312+0000","last_became_peered":"2024-05-14T15:17:08.641312+0000","last_unstale":"2024-05-14T15:17:09.641944+0000","last_undegraded":"2024-05-14T15:17:09.641944+0000","last_fullsized":"2024-05-14T15:17:09.641944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:50:16.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102615+0000","last_change":"2024-05-14T15:17:07.615137+0000","last_active":"2024-05-14T15:17:10.102615+0000","last_peered":"2024-05-14T15:17:10.102615+0000","last_clean":"2024-05-14T15:17:10.102615+0000","last_became_active":"2024-05-14T15:17:07.614667+0000","last_became_peered":"2024-05-14T15:17:07.614667+0000","last_unstale":"2024-05-14T15:17:10.102615+0000","last_undegraded":"2024-05-14T15:17:10.102615+0000","last_fullsized":"2024-05-14T15:17:10.102615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:44:04.709006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103606+0000","last_change":"2024-05-14T15:17:08.630027+0000","last_active":"2024-05-14T15:17:10.103606+0000","last_peered":"2024-05-14T15:17:10.103606+0000","last_clean":"2024-05-14T15:17:10.103606+0000","last_became_active":"2024-05-14T15:17:08.629554+0000","last_became_peered":"2024-05-14T15:17:08.629554+0000","last_unstale":"2024-05-14T15:17:10.103606+0000","last_undegraded":"2024-05-14T15:17:10.103606+0000","last_fullsized":"2024-05-14T15:17:10.103606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:27:02.995737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103210+0000","last_change":"2024-05-14T15:17:07.611113+0000","last_active":"2024-05-14T15:17:10.103210+0000","last_peered":"2024-05-14T15:17:10.103210+0000","last_clean":"2024-05-14T15:17:10.103210+0000","last_became_active":"2024-05-14T15:17:07.610830+0000","last_became_peered":"2024-05-14T15:17:07.610830+0000","last_unstale":"2024-05-14T15:17:10.103210+0000","last_undegraded":"2024-05-14T15:17:10.103210+0000","last_fullsized":"2024-05-14T15:17:10.103210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:47:09.539116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637502+0000","last_change":"2024-05-14T15:17:08.656770+0000","last_active":"2024-05-14T15:17:09.637502+0000","last_peered":"2024-05-14T15:17:09.637502+0000","last_clean":"2024-05-14T15:17:09.637502+0000","last_became_active":"2024-05-14T15:17:08.655687+0000","last_became_peered":"2024-05-14T15:17:08.655687+0000","last_unstale":"2024-05-14T15:17:09.637502+0000","last_undegraded":"2024-05-14T15:17:09.637502+0000","last_fullsized":"2024-05-14T15:17:09.637502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:25:57.076989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641854+0000","last_change":"2024-05-14T15:17:07.615293+0000","last_active":"2024-05-14T15:17:09.641854+0000","last_peered":"2024-05-14T15:17:09.641854+0000","last_clean":"2024-05-14T15:17:09.641854+0000","last_became_active":"2024-05-14T15:17:07.614859+0000","last_became_peered":"2024-05-14T15:17:07.614859+0000","last_unstale":"2024-05-14T15:17:09.641854+0000","last_undegraded":"2024-05-14T15:17:09.641854+0000","last_fullsized":"2024-05-14T15:17:09.641854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:16.343961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101996+0000","last_change":"2024-05-14T15:17:08.625897+0000","last_active":"2024-05-14T15:17:10.101996+0000","last_peered":"2024-05-14T15:17:10.101996+0000","last_clean":"2024-05-14T15:17:10.101996+0000","last_became_active":"2024-05-14T15:17:08.625476+0000","last_became_peered":"2024-05-14T15:17:08.625476+0000","last_unstale":"2024-05-14T15:17:10.101996+0000","last_undegraded":"2024-05-14T15:17:10.101996+0000","last_fullsized":"2024-05-14T15:17:10.101996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:28:37.586671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101159+0000","last_change":"2024-05-14T15:17:07.619899+0000","last_active":"2024-05-14T15:17:10.101159+0000","last_peered":"2024-05-14T15:17:10.101159+0000","last_clean":"2024-05-14T15:17:10.101159+0000","last_became_active":"2024-05-14T15:17:07.619090+0000","last_became_peered":"2024-05-14T15:17:07.619090+0000","last_unstale":"2024-05-14T15:17:10.101159+0000","last_undegraded":"2024-05-14T15:17:10.101159+0000","last_fullsized":"2024-05-14T15:17:10.101159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:26:03.445798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643255+0000","last_change":"2024-05-14T15:17:08.646517+0000","last_active":"2024-05-14T15:17:09.643255+0000","last_peered":"2024-05-14T15:17:09.643255+0000","last_clean":"2024-05-14T15:17:09.643255+0000","last_became_active":"2024-05-14T15:17:08.645258+0000","last_became_peered":"2024-05-14T15:17:08.645258+0000","last_unstale":"2024-05-14T15:17:09.643255+0000","last_undegraded":"2024-05-14T15:17:09.643255+0000","last_fullsized":"2024-05-14T15:17:09.643255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:17.538195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643984+0000","last_change":"2024-05-14T15:17:07.607732+0000","last_active":"2024-05-14T15:17:09.643984+0000","last_peered":"2024-05-14T15:17:09.643984+0000","last_clean":"2024-05-14T15:17:09.643984+0000","last_became_active":"2024-05-14T15:17:07.607356+0000","last_became_peered":"2024-05-14T15:17:07.607356+0000","last_unstale":"2024-05-14T15:17:09.643984+0000","last_undegraded":"2024-05-14T15:17:09.643984+0000","last_fullsized":"2024-05-14T15:17:09.643984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:04:57.456664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103520+0000","last_change":"2024-05-14T15:17:08.644658+0000","last_active":"2024-05-14T15:17:10.103520+0000","last_peered":"2024-05-14T15:17:10.103520+0000","last_clean":"2024-05-14T15:17:10.103520+0000","last_became_active":"2024-05-14T15:17:08.644274+0000","last_became_peered":"2024-05-14T15:17:08.644274+0000","last_unstale":"2024-05-14T15:17:10.103520+0000","last_undegraded":"2024-05-14T15:17:10.103520+0000","last_fullsized":"2024-05-14T15:17:10.103520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:27:46.422523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639095+0000","last_change":"2024-05-14T15:17:07.623881+0000","last_active":"2024-05-14T15:17:09.639095+0000","last_peered":"2024-05-14T15:17:09.639095+0000","last_clean":"2024-05-14T15:17:09.639095+0000","last_became_active":"2024-05-14T15:17:07.623479+0000","last_became_peered":"2024-05-14T15:17:07.623479+0000","last_unstale":"2024-05-14T15:17:09.639095+0000","last_undegraded":"2024-05-14T15:17:09.639095+0000","last_fullsized":"2024-05-14T15:17:09.639095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:07:19.650319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.644014+0000","last_change":"2024-05-14T15:17:08.663164+0000","last_active":"2024-05-14T15:17:09.644014+0000","last_peered":"2024-05-14T15:17:09.644014+0000","last_clean":"2024-05-14T15:17:09.644014+0000","last_became_active":"2024-05-14T15:17:08.662883+0000","last_became_peered":"2024-05-14T15:17:08.662883+0000","last_unstale":"2024-05-14T15:17:09.644014+0000","last_undegraded":"2024-05-14T15:17:09.644014+0000","last_fullsized":"2024-05-14T15:17:09.644014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:04:59.926808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638305+0000","last_change":"2024-05-14T15:17:07.611569+0000","last_active":"2024-05-14T15:17:09.638305+0000","last_peered":"2024-05-14T15:17:09.638305+0000","last_clean":"2024-05-14T15:17:09.638305+0000","last_became_active":"2024-05-14T15:17:07.610204+0000","last_became_peered":"2024-05-14T15:17:07.610204+0000","last_unstale":"2024-05-14T15:17:09.638305+0000","last_undegraded":"2024-05-14T15:17:09.638305+0000","last_fullsized":"2024-05-14T15:17:09.638305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:24:28.381510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102507+0000","last_change":"2024-05-14T15:17:08.647571+0000","last_active":"2024-05-14T15:17:10.102507+0000","last_peered":"2024-05-14T15:17:10.102507+0000","last_clean":"2024-05-14T15:17:10.102507+0000","last_became_active":"2024-05-14T15:17:08.647392+0000","last_became_peered":"2024-05-14T15:17:08.647392+0000","last_unstale":"2024-05-14T15:17:10.102507+0000","last_undegraded":"2024-05-14T15:17:10.102507+0000","last_fullsized":"2024-05-14T15:17:10.102507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:22:29.589313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643598+0000","last_change":"2024-05-14T15:17:07.613118+0000","last_active":"2024-05-14T15:17:09.643598+0000","last_peered":"2024-05-14T15:17:09.643598+0000","last_clean":"2024-05-14T15:17:09.643598+0000","last_became_active":"2024-05-14T15:17:07.612479+0000","last_became_peered":"2024-05-14T15:17:07.612479+0000","last_unstale":"2024-05-14T15:17:09.643598+0000","last_undegraded":"2024-05-14T15:17:09.643598+0000","last_fullsized":"2024-05-14T15:17:09.643598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:10:07.348206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.642490+0000","last_change":"2024-05-14T15:17:08.644491+0000","last_active":"2024-05-14T15:17:09.642490+0000","last_peered":"2024-05-14T15:17:09.642490+0000","last_clean":"2024-05-14T15:17:09.642490+0000","last_became_active":"2024-05-14T15:17:08.641265+0000","last_became_peered":"2024-05-14T15:17:08.641265+0000","last_unstale":"2024-05-14T15:17:09.642490+0000","last_undegraded":"2024-05-14T15:17:09.642490+0000","last_fullsized":"2024-05-14T15:17:09.642490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:23:29.937899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640879+0000","last_change":"2024-05-14T15:17:07.620315+0000","last_active":"2024-05-14T15:17:09.640879+0000","last_peered":"2024-05-14T15:17:09.640879+0000","last_clean":"2024-05-14T15:17:09.640879+0000","last_became_active":"2024-05-14T15:17:07.619996+0000","last_became_peered":"2024-05-14T15:17:07.619996+0000","last_unstale":"2024-05-14T15:17:09.640879+0000","last_undegraded":"2024-05-14T15:17:09.640879+0000","last_fullsized":"2024-05-14T15:17:09.640879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:30.104835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101326+0000","last_change":"2024-05-14T15:17:08.651255+0000","last_active":"2024-05-14T15:17:10.101326+0000","last_peered":"2024-05-14T15:17:10.101326+0000","last_clean":"2024-05-14T15:17:10.101326+0000","last_became_active":"2024-05-14T15:17:08.650108+0000","last_became_peered":"2024-05-14T15:17:08.650108+0000","last_unstale":"2024-05-14T15:17:10.101326+0000","last_undegraded":"2024-05-14T15:17:10.101326+0000","last_fullsized":"2024-05-14T15:17:10.101326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:55:49.925615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101733+0000","last_change":"2024-05-14T15:17:07.621657+0000","last_active":"2024-05-14T15:17:10.101733+0000","last_peered":"2024-05-14T15:17:10.101733+0000","last_clean":"2024-05-14T15:17:10.101733+0000","last_became_active":"2024-05-14T15:17:07.621298+0000","last_became_peered":"2024-05-14T15:17:07.621298+0000","last_unstale":"2024-05-14T15:17:10.101733+0000","last_undegraded":"2024-05-14T15:17:10.101733+0000","last_fullsized":"2024-05-14T15:17:10.101733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:14.267105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105232+0000","last_change":"2024-05-14T15:17:08.646544+0000","last_active":"2024-05-14T15:17:10.105232+0000","last_peered":"2024-05-14T15:17:10.105232+0000","last_clean":"2024-05-14T15:17:10.105232+0000","last_became_active":"2024-05-14T15:17:08.646205+0000","last_became_peered":"2024-05-14T15:17:08.646205+0000","last_unstale":"2024-05-14T15:17:10.105232+0000","last_undegraded":"2024-05-14T15:17:10.105232+0000","last_fullsized":"2024-05-14T15:17:10.105232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:28:37.586671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637218+0000","last_change":"2024-05-14T15:17:07.611460+0000","last_active":"2024-05-14T15:17:09.637218+0000","last_peered":"2024-05-14T15:17:09.637218+0000","last_clean":"2024-05-14T15:17:09.637218+0000","last_became_active":"2024-05-14T15:17:07.609712+0000","last_became_peered":"2024-05-14T15:17:07.609712+0000","last_unstale":"2024-05-14T15:17:09.637218+0000","last_undegraded":"2024-05-14T15:17:09.637218+0000","last_fullsized":"2024-05-14T15:17:09.637218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:20.668756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102739+0000","last_change":"2024-05-14T15:17:08.649411+0000","last_active":"2024-05-14T15:17:10.102739+0000","last_peered":"2024-05-14T15:17:10.102739+0000","last_clean":"2024-05-14T15:17:10.102739+0000","last_became_active":"2024-05-14T15:17:08.648336+0000","last_became_peered":"2024-05-14T15:17:08.648336+0000","last_unstale":"2024-05-14T15:17:10.102739+0000","last_undegraded":"2024-05-14T15:17:10.102739+0000","last_fullsized":"2024-05-14T15:17:10.102739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:22:29.589313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101634+0000","last_change":"2024-05-14T15:17:07.607917+0000","last_active":"2024-05-14T15:17:10.101634+0000","last_peered":"2024-05-14T15:17:10.101634+0000","last_clean":"2024-05-14T15:17:10.101634+0000","last_became_active":"2024-05-14T15:17:07.607523+0000","last_became_peered":"2024-05-14T15:17:07.607523+0000","last_unstale":"2024-05-14T15:17:10.101634+0000","last_undegraded":"2024-05-14T15:17:10.101634+0000","last_fullsized":"2024-05-14T15:17:10.101634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:06:22.038696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102878+0000","last_change":"2024-05-14T15:17:08.651593+0000","last_active":"2024-05-14T15:17:10.102878+0000","last_peered":"2024-05-14T15:17:10.102878+0000","last_clean":"2024-05-14T15:17:10.102878+0000","last_became_active":"2024-05-14T15:17:08.650086+0000","last_became_peered":"2024-05-14T15:17:08.650086+0000","last_unstale":"2024-05-14T15:17:10.102878+0000","last_undegraded":"2024-05-14T15:17:10.102878+0000","last_fullsized":"2024-05-14T15:17:10.102878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:03.804373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102681+0000","last_change":"2024-05-14T15:17:07.609082+0000","last_active":"2024-05-14T15:17:10.102681+0000","last_peered":"2024-05-14T15:17:10.102681+0000","last_clean":"2024-05-14T15:17:10.102681+0000","last_became_active":"2024-05-14T15:17:07.608766+0000","last_became_peered":"2024-05-14T15:17:07.608766+0000","last_unstale":"2024-05-14T15:17:10.102681+0000","last_undegraded":"2024-05-14T15:17:10.102681+0000","last_fullsized":"2024-05-14T15:17:10.102681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:06:46.462960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104549+0000","last_change":"2024-05-14T15:17:08.652457+0000","last_active":"2024-05-14T15:17:10.104549+0000","last_peered":"2024-05-14T15:17:10.104549+0000","last_clean":"2024-05-14T15:17:10.104549+0000","last_became_active":"2024-05-14T15:17:08.652132+0000","last_became_peered":"2024-05-14T15:17:08.652132+0000","last_unstale":"2024-05-14T15:17:10.104549+0000","last_undegraded":"2024-05-14T15:17:10.104549+0000","last_fullsized":"2024-05-14T15:17:10.104549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:07.116826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639550+0000","last_change":"2024-05-14T15:17:07.610533+0000","last_active":"2024-05-14T15:17:09.639550+0000","last_peered":"2024-05-14T15:17:09.639550+0000","last_clean":"2024-05-14T15:17:09.639550+0000","last_became_active":"2024-05-14T15:17:07.610061+0000","last_became_peered":"2024-05-14T15:17:07.610061+0000","last_unstale":"2024-05-14T15:17:09.639550+0000","last_undegraded":"2024-05-14T15:17:09.639550+0000","last_fullsized":"2024-05-14T15:17:09.639550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:46.645743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104780+0000","last_change":"2024-05-14T15:17:08.648896+0000","last_active":"2024-05-14T15:17:10.104780+0000","last_peered":"2024-05-14T15:17:10.104780+0000","last_clean":"2024-05-14T15:17:10.104780+0000","last_became_active":"2024-05-14T15:17:08.648498+0000","last_became_peered":"2024-05-14T15:17:08.648498+0000","last_unstale":"2024-05-14T15:17:10.104780+0000","last_undegraded":"2024-05-14T15:17:10.104780+0000","last_fullsized":"2024-05-14T15:17:10.104780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:46:53.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103061+0000","last_change":"2024-05-14T15:17:07.623527+0000","last_active":"2024-05-14T15:17:10.103061+0000","last_peered":"2024-05-14T15:17:10.103061+0000","last_clean":"2024-05-14T15:17:10.103061+0000","last_became_active":"2024-05-14T15:17:07.622867+0000","last_became_peered":"2024-05-14T15:17:07.622867+0000","last_unstale":"2024-05-14T15:17:10.103061+0000","last_undegraded":"2024-05-14T15:17:10.103061+0000","last_fullsized":"2024-05-14T15:17:10.103061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:06:46.462960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640978+0000","last_change":"2024-05-14T15:17:08.644712+0000","last_active":"2024-05-14T15:17:09.640978+0000","last_peered":"2024-05-14T15:17:09.640978+0000","last_clean":"2024-05-14T15:17:09.640978+0000","last_became_active":"2024-05-14T15:17:08.644410+0000","last_became_peered":"2024-05-14T15:17:08.644410+0000","last_unstale":"2024-05-14T15:17:09.640978+0000","last_undegraded":"2024-05-14T15:17:09.640978+0000","last_fullsized":"2024-05-14T15:17:09.640978+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:03.770193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640346+0000","last_change":"2024-05-14T15:17:07.611088+0000","last_active":"2024-05-14T15:17:09.640346+0000","last_peered":"2024-05-14T15:17:09.640346+0000","last_clean":"2024-05-14T15:17:09.640346+0000","last_became_active":"2024-05-14T15:17:07.610766+0000","last_became_peered":"2024-05-14T15:17:07.610766+0000","last_unstale":"2024-05-14T15:17:09.640346+0000","last_undegraded":"2024-05-14T15:17:09.640346+0000","last_fullsized":"2024-05-14T15:17:09.640346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:46:52.723786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637222+0000","last_change":"2024-05-14T15:17:08.649932+0000","last_active":"2024-05-14T15:17:09.637222+0000","last_peered":"2024-05-14T15:17:09.637222+0000","last_clean":"2024-05-14T15:17:09.637222+0000","last_became_active":"2024-05-14T15:17:08.649621+0000","last_became_peered":"2024-05-14T15:17:08.649621+0000","last_unstale":"2024-05-14T15:17:09.637222+0000","last_undegraded":"2024-05-14T15:17:09.637222+0000","last_fullsized":"2024-05-14T15:17:09.637222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:11.681650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640086+0000","last_change":"2024-05-14T15:17:07.616688+0000","last_active":"2024-05-14T15:17:09.640086+0000","last_peered":"2024-05-14T15:17:09.640086+0000","last_clean":"2024-05-14T15:17:09.640086+0000","last_became_active":"2024-05-14T15:17:07.616347+0000","last_became_peered":"2024-05-14T15:17:07.616347+0000","last_unstale":"2024-05-14T15:17:09.640086+0000","last_undegraded":"2024-05-14T15:17:09.640086+0000","last_fullsized":"2024-05-14T15:17:09.640086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:49:01.041123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641751+0000","last_change":"2024-05-14T15:17:08.660666+0000","last_active":"2024-05-14T15:17:09.641751+0000","last_peered":"2024-05-14T15:17:09.641751+0000","last_clean":"2024-05-14T15:17:09.641751+0000","last_became_active":"2024-05-14T15:17:08.660282+0000","last_became_peered":"2024-05-14T15:17:08.660282+0000","last_unstale":"2024-05-14T15:17:09.641751+0000","last_undegraded":"2024-05-14T15:17:09.641751+0000","last_fullsized":"2024-05-14T15:17:09.641751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:11:45.458618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102015+0000","last_change":"2024-05-14T15:17:07.621928+0000","last_active":"2024-05-14T15:17:10.102015+0000","last_peered":"2024-05-14T15:17:10.102015+0000","last_clean":"2024-05-14T15:17:10.102015+0000","last_became_active":"2024-05-14T15:17:07.621606+0000","last_became_peered":"2024-05-14T15:17:07.621606+0000","last_unstale":"2024-05-14T15:17:10.102015+0000","last_undegraded":"2024-05-14T15:17:10.102015+0000","last_fullsized":"2024-05-14T15:17:10.102015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:14:54.292306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105299+0000","last_change":"2024-05-14T15:17:08.662009+0000","last_active":"2024-05-14T15:17:10.105299+0000","last_peered":"2024-05-14T15:17:10.105299+0000","last_clean":"2024-05-14T15:17:10.105299+0000","last_became_active":"2024-05-14T15:17:08.661595+0000","last_became_peered":"2024-05-14T15:17:08.661595+0000","last_unstale":"2024-05-14T15:17:10.105299+0000","last_undegraded":"2024-05-14T15:17:10.105299+0000","last_fullsized":"2024-05-14T15:17:10.105299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:03.770193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102884+0000","last_change":"2024-05-14T15:17:07.618153+0000","last_active":"2024-05-14T15:17:10.102884+0000","last_peered":"2024-05-14T15:17:10.102884+0000","last_clean":"2024-05-14T15:17:10.102884+0000","last_became_active":"2024-05-14T15:17:07.612460+0000","last_became_peered":"2024-05-14T15:17:07.612460+0000","last_unstale":"2024-05-14T15:17:10.102884+0000","last_undegraded":"2024-05-14T15:17:10.102884+0000","last_fullsized":"2024-05-14T15:17:10.102884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:51:38.180762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640571+0000","last_change":"2024-05-14T15:17:08.651512+0000","last_active":"2024-05-14T15:17:09.640571+0000","last_peered":"2024-05-14T15:17:09.640571+0000","last_clean":"2024-05-14T15:17:09.640571+0000","last_became_active":"2024-05-14T15:17:08.651177+0000","last_became_peered":"2024-05-14T15:17:08.651177+0000","last_unstale":"2024-05-14T15:17:09.640571+0000","last_undegraded":"2024-05-14T15:17:09.640571+0000","last_fullsized":"2024-05-14T15:17:09.640571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:09:33.272092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.100635+0000","last_change":"2024-05-14T15:17:07.620245+0000","last_active":"2024-05-14T15:17:10.100635+0000","last_peered":"2024-05-14T15:17:10.100635+0000","last_clean":"2024-05-14T15:17:10.100635+0000","last_became_active":"2024-05-14T15:17:07.619098+0000","last_became_peered":"2024-05-14T15:17:07.619098+0000","last_unstale":"2024-05-14T15:17:10.100635+0000","last_undegraded":"2024-05-14T15:17:10.100635+0000","last_fullsized":"2024-05-14T15:17:10.100635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:06:22.038696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103381+0000","last_change":"2024-05-14T15:17:08.661547+0000","last_active":"2024-05-14T15:17:10.103381+0000","last_peered":"2024-05-14T15:17:10.103381+0000","last_clean":"2024-05-14T15:17:10.103381+0000","last_became_active":"2024-05-14T15:17:08.661192+0000","last_became_peered":"2024-05-14T15:17:08.661192+0000","last_unstale":"2024-05-14T15:17:10.103381+0000","last_undegraded":"2024-05-14T15:17:10.103381+0000","last_fullsized":"2024-05-14T15:17:10.103381+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:09:06.196387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639058+0000","last_change":"2024-05-14T15:17:07.619456+0000","last_active":"2024-05-14T15:17:09.639058+0000","last_peered":"2024-05-14T15:17:09.639058+0000","last_clean":"2024-05-14T15:17:09.639058+0000","last_became_active":"2024-05-14T15:17:07.619106+0000","last_became_peered":"2024-05-14T15:17:07.619106+0000","last_unstale":"2024-05-14T15:17:09.639058+0000","last_undegraded":"2024-05-14T15:17:09.639058+0000","last_fullsized":"2024-05-14T15:17:09.639058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:37:58.907748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.106440+0000","last_change":"2024-05-14T15:17:08.661902+0000","last_active":"2024-05-14T15:17:10.106440+0000","last_peered":"2024-05-14T15:17:10.106440+0000","last_clean":"2024-05-14T15:17:10.106440+0000","last_became_active":"2024-05-14T15:17:08.661555+0000","last_became_peered":"2024-05-14T15:17:08.661555+0000","last_unstale":"2024-05-14T15:17:10.106440+0000","last_undegraded":"2024-05-14T15:17:10.106440+0000","last_fullsized":"2024-05-14T15:17:10.106440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:01:48.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103883+0000","last_change":"2024-05-14T15:17:07.621675+0000","last_active":"2024-05-14T15:17:10.103883+0000","last_peered":"2024-05-14T15:17:10.103883+0000","last_clean":"2024-05-14T15:17:10.103883+0000","last_became_active":"2024-05-14T15:17:07.621351+0000","last_became_peered":"2024-05-14T15:17:07.621351+0000","last_unstale":"2024-05-14T15:17:10.103883+0000","last_undegraded":"2024-05-14T15:17:10.103883+0000","last_fullsized":"2024-05-14T15:17:10.103883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:47:09.539116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640174+0000","last_change":"2024-05-14T15:17:08.644025+0000","last_active":"2024-05-14T15:17:09.640174+0000","last_peered":"2024-05-14T15:17:09.640174+0000","last_clean":"2024-05-14T15:17:09.640174+0000","last_became_active":"2024-05-14T15:17:08.643642+0000","last_became_peered":"2024-05-14T15:17:08.643642+0000","last_unstale":"2024-05-14T15:17:09.640174+0000","last_undegraded":"2024-05-14T15:17:09.640174+0000","last_fullsized":"2024-05-14T15:17:09.640174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:28:37.586671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103638+0000","last_change":"2024-05-14T15:17:07.623764+0000","last_active":"2024-05-14T15:17:10.103638+0000","last_peered":"2024-05-14T15:17:10.103638+0000","last_clean":"2024-05-14T15:17:10.103638+0000","last_became_active":"2024-05-14T15:17:07.623325+0000","last_became_peered":"2024-05-14T15:17:07.623325+0000","last_unstale":"2024-05-14T15:17:10.103638+0000","last_undegraded":"2024-05-14T15:17:10.103638+0000","last_fullsized":"2024-05-14T15:17:10.103638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:05.248283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101453+0000","last_change":"2024-05-14T15:17:08.652293+0000","last_active":"2024-05-14T15:17:10.101453+0000","last_peered":"2024-05-14T15:17:10.101453+0000","last_clean":"2024-05-14T15:17:10.101453+0000","last_became_active":"2024-05-14T15:17:08.651896+0000","last_became_peered":"2024-05-14T15:17:08.651896+0000","last_unstale":"2024-05-14T15:17:10.101453+0000","last_undegraded":"2024-05-14T15:17:10.101453+0000","last_fullsized":"2024-05-14T15:17:10.101453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:15.283642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.642888+0000","last_change":"2024-05-14T15:17:07.620613+0000","last_active":"2024-05-14T15:17:09.642888+0000","last_peered":"2024-05-14T15:17:09.642888+0000","last_clean":"2024-05-14T15:17:09.642888+0000","last_became_active":"2024-05-14T15:17:07.619968+0000","last_became_peered":"2024-05-14T15:17:07.619968+0000","last_unstale":"2024-05-14T15:17:09.642888+0000","last_undegraded":"2024-05-14T15:17:09.642888+0000","last_fullsized":"2024-05-14T15:17:09.642888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:23.622896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101818+0000","last_change":"2024-05-14T15:17:08.649599+0000","last_active":"2024-05-14T15:17:10.101818+0000","last_peered":"2024-05-14T15:17:10.101818+0000","last_clean":"2024-05-14T15:17:10.101818+0000","last_became_active":"2024-05-14T15:17:08.649266+0000","last_became_peered":"2024-05-14T15:17:08.649266+0000","last_unstale":"2024-05-14T15:17:10.101818+0000","last_undegraded":"2024-05-14T15:17:10.101818+0000","last_fullsized":"2024-05-14T15:17:10.101818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:31:21.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105301+0000","last_change":"2024-05-14T15:17:07.619008+0000","last_active":"2024-05-14T15:17:10.105301+0000","last_peered":"2024-05-14T15:17:10.105301+0000","last_clean":"2024-05-14T15:17:10.105301+0000","last_became_active":"2024-05-14T15:17:07.618709+0000","last_became_peered":"2024-05-14T15:17:07.618709+0000","last_unstale":"2024-05-14T15:17:10.105301+0000","last_undegraded":"2024-05-14T15:17:10.105301+0000","last_fullsized":"2024-05-14T15:17:10.105301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:14.267105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638062+0000","last_change":"2024-05-14T15:17:08.655258+0000","last_active":"2024-05-14T15:17:09.638062+0000","last_peered":"2024-05-14T15:17:09.638062+0000","last_clean":"2024-05-14T15:17:09.638062+0000","last_became_active":"2024-05-14T15:17:08.654922+0000","last_became_peered":"2024-05-14T15:17:08.654922+0000","last_unstale":"2024-05-14T15:17:09.638062+0000","last_undegraded":"2024-05-14T15:17:09.638062+0000","last_fullsized":"2024-05-14T15:17:09.638062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:08:21.339685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637385+0000","last_change":"2024-05-14T15:17:07.614107+0000","last_active":"2024-05-14T15:17:09.637385+0000","last_peered":"2024-05-14T15:17:09.637385+0000","last_clean":"2024-05-14T15:17:09.637385+0000","last_became_active":"2024-05-14T15:17:07.613803+0000","last_became_peered":"2024-05-14T15:17:07.613803+0000","last_unstale":"2024-05-14T15:17:09.637385+0000","last_undegraded":"2024-05-14T15:17:09.637385+0000","last_fullsized":"2024-05-14T15:17:09.637385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:21.125875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105898+0000","last_change":"2024-05-14T15:17:08.641458+0000","last_active":"2024-05-14T15:17:10.105898+0000","last_peered":"2024-05-14T15:17:10.105898+0000","last_clean":"2024-05-14T15:17:10.105898+0000","last_became_active":"2024-05-14T15:17:08.638469+0000","last_became_peered":"2024-05-14T15:17:08.638469+0000","last_unstale":"2024-05-14T15:17:10.105898+0000","last_undegraded":"2024-05-14T15:17:10.105898+0000","last_fullsized":"2024-05-14T15:17:10.105898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:12:08.191422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.642346+0000","last_change":"2024-05-14T15:17:07.602639+0000","last_active":"2024-05-14T15:17:09.642346+0000","last_peered":"2024-05-14T15:17:09.642346+0000","last_clean":"2024-05-14T15:17:09.642346+0000","last_became_active":"2024-05-14T15:17:07.602178+0000","last_became_peered":"2024-05-14T15:17:07.602178+0000","last_unstale":"2024-05-14T15:17:09.642346+0000","last_undegraded":"2024-05-14T15:17:09.642346+0000","last_fullsized":"2024-05-14T15:17:09.642346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:48.942945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639268+0000","last_change":"2024-05-14T15:17:08.645773+0000","last_active":"2024-05-14T15:17:09.639268+0000","last_peered":"2024-05-14T15:17:09.639268+0000","last_clean":"2024-05-14T15:17:09.639268+0000","last_became_active":"2024-05-14T15:17:08.645410+0000","last_became_peered":"2024-05-14T15:17:08.645410+0000","last_unstale":"2024-05-14T15:17:09.639268+0000","last_undegraded":"2024-05-14T15:17:09.639268+0000","last_fullsized":"2024-05-14T15:17:09.639268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:12:55.781604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105644+0000","last_change":"2024-05-14T15:17:07.620669+0000","last_active":"2024-05-14T15:17:10.105644+0000","last_peered":"2024-05-14T15:17:10.105644+0000","last_clean":"2024-05-14T15:17:10.105644+0000","last_became_active":"2024-05-14T15:17:07.620170+0000","last_became_peered":"2024-05-14T15:17:07.620170+0000","last_unstale":"2024-05-14T15:17:10.105644+0000","last_undegraded":"2024-05-14T15:17:10.105644+0000","last_fullsized":"2024-05-14T15:17:10.105644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:22:28.572775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101488+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:17:10.101488+0000","last_peered":"2024-05-14T15:17:10.101488+0000","last_clean":"2024-05-14T15:17:10.101488+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:17:10.101488+0000","last_undegraded":"2024-05-14T15:17:10.101488+0000","last_fullsized":"2024-05-14T15:17:10.101488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":194572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":194536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":785452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":194592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":196696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":784892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":194594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":475136,"data_stored":196238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:17:13.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:17:13.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.721+0000 7f789a400640 1 Processor -- start 2024-05-14T15:17:13.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.722+0000 7f789a400640 1 -- start start 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f789a400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78940b56a0 0x7f78940b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f789a400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f789415ca80 0x7f78940b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f789a400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f789406d700 0x7f789406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f789a400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f78940b5ab0 con 0x7f789406d700 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f789a400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f789406e050 con 0x7f789415ca80 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f789a400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f78940b0a70 con 0x7f78940b56a0 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f7899a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f789406d700 0x7f789406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f7899a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f789406d700 0x7f789406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58790/0 (socket says 172.21.15.2:58790) 2024-05-14T15:17:13.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.725+0000 7f7899a00640 1 -- 172.21.15.2:0/400448119 learned_addr learned my addr 172.21.15.2:0/400448119 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7893e00640 1 --2- 172.21.15.2:0/400448119 >> v2:172.21.15.156:3300/0 conn(0x7f789415ca80 0x7f78940b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7899000640 1 --2- 172.21.15.2:0/400448119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78940b56a0 0x7f78940b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7899a00640 1 -- 172.21.15.2:0/400448119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78940b56a0 msgr2=0x7f78940b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7899a00640 1 --2- 172.21.15.2:0/400448119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78940b56a0 0x7f78940b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7899a00640 1 -- 172.21.15.2:0/400448119 >> v2:172.21.15.156:3300/0 conn(0x7f789415ca80 msgr2=0x7f78940b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7899a00640 1 --2- 172.21.15.2:0/400448119 >> v2:172.21.15.156:3300/0 conn(0x7f789415ca80 0x7f78940b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.726+0000 7f7899a00640 1 -- 172.21.15.2:0/400448119 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78940b0d10 con 0x7f789406d700 2024-05-14T15:17:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.727+0000 7f7899a00640 1 --2- 172.21.15.2:0/400448119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789406d700 0x7f789406db10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7894069690 tx=0x7f788c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5caee83e4e5a30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.727+0000 7f7893400640 1 -- 172.21.15.2:0/400448119 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c037070 con 0x7f789406d700 2024-05-14T15:17:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.727+0000 7f7893400640 1 -- 172.21.15.2:0/400448119 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c032440 con 0x7f789406d700 2024-05-14T15:17:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.727+0000 7f7893400640 1 -- 172.21.15.2:0/400448119 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c032810 con 0x7f789406d700 2024-05-14T15:17:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 -- 172.21.15.2:0/400448119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789406d700 msgr2=0x7f789406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 --2- 172.21.15.2:0/400448119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789406d700 0x7f789406db10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7894069690 tx=0x7f788c02a1e0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 -- 172.21.15.2:0/400448119 shutdown_connections 2024-05-14T15:17:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 --2- 172.21.15.2:0/400448119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f789406d700 0x7f789406db10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 --2- 172.21.15.2:0/400448119 >> v2:172.21.15.156:3300/0 conn(0x7f789415ca80 0x7f78940b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 --2- 172.21.15.2:0/400448119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78940b56a0 0x7f78940b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 -- 172.21.15.2:0/400448119 >> 172.21.15.2:0/400448119 conn(0x7f78940732e0 msgr2=0x7f78940736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 -- 172.21.15.2:0/400448119 shutdown_connections 2024-05-14T15:17:13.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.728+0000 7f789a400640 1 -- 172.21.15.2:0/400448119 wait complete. 2024-05-14T15:17:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.731+0000 7f789a400640 1 Processor -- start 2024-05-14T15:17:13.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.731+0000 7f789a400640 1 -- start start 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.732+0000 7f789a400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789406d700 0x7f7894150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.732+0000 7f789a400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 0x7f789409d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.732+0000 7f789a400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789415ca80 0x7f789409dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.732+0000 7f789a400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78940b4ea0 con 0x7f78940b56a0 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.732+0000 7f789a400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f78940b4bc0 con 0x7f789406d700 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.732+0000 7f789a400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f78940b5180 con 0x7f789415ca80 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 0x7f789409d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 0x7f789409d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58800/0 (socket says 172.21.15.2:58800) 2024-05-14T15:17:13.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 -- 172.21.15.2:0/957258183 learned_addr learned my addr 172.21.15.2:0/957258183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7899000640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789406d700 0x7f7894150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 -- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789415ca80 msgr2=0x7f789409dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789415ca80 0x7f789409dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 -- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789406d700 msgr2=0x7f7894150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789406d700 0x7f7894150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 -- 172.21.15.2:0/957258183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789415dbb0 con 0x7f78940b56a0 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7899000640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789406d700 0x7f7894150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:13.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.733+0000 7f7893e00640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 0x7f789409d590 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c5a0 tx=0x7f787c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.734+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c015070 con 0x7f78940b56a0 2024-05-14T15:17:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.734+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c004220 con 0x7f78940b56a0 2024-05-14T15:17:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.734+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c003610 con 0x7f78940b56a0 2024-05-14T15:17:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.734+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789415de90 con 0x7f78940b56a0 2024-05-14T15:17:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.734+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789415e450 con 0x7f78940b56a0 2024-05-14T15:17:13.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.735+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78940b67a0 con 0x7f78940b56a0 2024-05-14T15:17:13.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.736+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f787c0037b0 con 0x7f78940b56a0 2024-05-14T15:17:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.737+0000 7f7890c00640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7870076300 0x7f7870078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.737+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f787c0975c0 con 0x7f78940b56a0 2024-05-14T15:17:13.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.738+0000 7f7899000640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7870076300 0x7f7870078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:13.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.739+0000 7f7899000640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7870076300 0x7f7870078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7884007eb0 tx=0x7f7884007400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.743+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f787c060c70 con 0x7f78940b56a0 2024-05-14T15:17:13.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.952+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78940d0da0 con 0x7f7870076300 2024-05-14T15:17:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.972+0000 7f7890c00640 1 -- 172.21.15.2:0/957258183 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f78940d0da0 con 0x7f7870076300 2024-05-14T15:17:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:13.975 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7870076300 msgr2=0x7f7870078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7870076300 0x7f7870078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7884007eb0 tx=0x7f7884007400 comp rx=0 tx=0).stop 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 msgr2=0x7f789409d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 0x7f789409d590 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c5a0 tx=0x7f787c00ca60 comp rx=0 tx=0).stop 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 shutdown_connections 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7870076300 0x7f7870078810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789415ca80 0x7f789409dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78940b56a0 0x7f789409d590 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 --2- 172.21.15.2:0/957258183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789406d700 0x7f7894150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 >> 172.21.15.2:0/957258183 conn(0x7f78940732e0 msgr2=0x7f78941572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 shutdown_connections 2024-05-14T15:17:13.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:13.978+0000 7f789a400640 1 -- 172.21.15.2:0/957258183 wait complete. 2024-05-14T15:17:14.003 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-05-14T15:17:12.882555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254260,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720460,"statfs":{"total":773094113280,"available":772833751040,"internally_reserved":0,"allocated":4890624,"data_stored":2741572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001859"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.644048+0000","last_change":"2024-05-14T15:17:08.643493+0000","last_active":"2024-05-14T15:17:09.644048+0000","last_peered":"2024-05-14T15:17:09.644048+0000","last_clean":"2024-05-14T15:17:09.644048+0000","last_became_active":"2024-05-14T15:17:08.643148+0000","last_became_peered":"2024-05-14T15:17:08.643148+0000","last_unstale":"2024-05-14T15:17:09.644048+0000","last_undegraded":"2024-05-14T15:17:09.644048+0000","last_fullsized":"2024-05-14T15:17:09.644048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:03:34.016906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103363+0000","last_change":"2024-05-14T15:17:08.654500+0000","last_active":"2024-05-14T15:17:10.103363+0000","last_peered":"2024-05-14T15:17:10.103363+0000","last_clean":"2024-05-14T15:17:10.103363+0000","last_became_active":"2024-05-14T15:17:08.654209+0000","last_became_peered":"2024-05-14T15:17:08.654209+0000","last_unstale":"2024-05-14T15:17:10.103363+0000","last_undegraded":"2024-05-14T15:17:10.103363+0000","last_fullsized":"2024-05-14T15:17:10.103363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:12:08.191422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643547+0000","last_change":"2024-05-14T15:17:08.646982+0000","last_active":"2024-05-14T15:17:09.643547+0000","last_peered":"2024-05-14T15:17:09.643547+0000","last_clean":"2024-05-14T15:17:09.643547+0000","last_became_active":"2024-05-14T15:17:08.645840+0000","last_became_peered":"2024-05-14T15:17:08.645840+0000","last_unstale":"2024-05-14T15:17:09.643547+0000","last_undegraded":"2024-05-14T15:17:09.643547+0000","last_fullsized":"2024-05-14T15:17:09.643547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:50:10.466423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643109+0000","last_change":"2024-05-14T15:17:08.657277+0000","last_active":"2024-05-14T15:17:09.643109+0000","last_peered":"2024-05-14T15:17:09.643109+0000","last_clean":"2024-05-14T15:17:09.643109+0000","last_became_active":"2024-05-14T15:17:08.656888+0000","last_became_peered":"2024-05-14T15:17:08.656888+0000","last_unstale":"2024-05-14T15:17:09.643109+0000","last_undegraded":"2024-05-14T15:17:09.643109+0000","last_fullsized":"2024-05-14T15:17:09.643109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:30.146038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102664+0000","last_change":"2024-05-14T15:17:08.653927+0000","last_active":"2024-05-14T15:17:10.102664+0000","last_peered":"2024-05-14T15:17:10.102664+0000","last_clean":"2024-05-14T15:17:10.102664+0000","last_became_active":"2024-05-14T15:17:08.653674+0000","last_became_peered":"2024-05-14T15:17:08.653674+0000","last_unstale":"2024-05-14T15:17:10.102664+0000","last_undegraded":"2024-05-14T15:17:10.102664+0000","last_fullsized":"2024-05-14T15:17:10.102664+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:14:55.308844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102517+0000","last_change":"2024-05-14T15:17:08.635281+0000","last_active":"2024-05-14T15:17:10.102517+0000","last_peered":"2024-05-14T15:17:10.102517+0000","last_clean":"2024-05-14T15:17:10.102517+0000","last_became_active":"2024-05-14T15:17:08.634930+0000","last_became_peered":"2024-05-14T15:17:08.634930+0000","last_unstale":"2024-05-14T15:17:10.102517+0000","last_undegraded":"2024-05-14T15:17:10.102517+0000","last_fullsized":"2024-05-14T15:17:10.102517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:03.770193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103163+0000","last_change":"2024-05-14T15:17:08.657897+0000","last_active":"2024-05-14T15:17:10.103163+0000","last_peered":"2024-05-14T15:17:10.103163+0000","last_clean":"2024-05-14T15:17:10.103163+0000","last_became_active":"2024-05-14T15:17:08.646667+0000","last_became_peered":"2024-05-14T15:17:08.646667+0000","last_unstale":"2024-05-14T15:17:10.103163+0000","last_undegraded":"2024-05-14T15:17:10.103163+0000","last_fullsized":"2024-05-14T15:17:10.103163+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:11.051597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640321+0000","last_change":"2024-05-14T15:17:08.660999+0000","last_active":"2024-05-14T15:17:09.640321+0000","last_peered":"2024-05-14T15:17:09.640321+0000","last_clean":"2024-05-14T15:17:09.640321+0000","last_became_active":"2024-05-14T15:17:08.660666+0000","last_became_peered":"2024-05-14T15:17:08.660666+0000","last_unstale":"2024-05-14T15:17:09.640321+0000","last_undegraded":"2024-05-14T15:17:09.640321+0000","last_fullsized":"2024-05-14T15:17:09.640321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:56.225720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104162+0000","last_change":"2024-05-14T15:17:08.656945+0000","last_active":"2024-05-14T15:17:10.104162+0000","last_peered":"2024-05-14T15:17:10.104162+0000","last_clean":"2024-05-14T15:17:10.104162+0000","last_became_active":"2024-05-14T15:17:08.656058+0000","last_became_peered":"2024-05-14T15:17:08.656058+0000","last_unstale":"2024-05-14T15:17:10.104162+0000","last_undegraded":"2024-05-14T15:17:10.104162+0000","last_fullsized":"2024-05-14T15:17:10.104162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:11.051597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104649+0000","last_change":"2024-05-14T15:17:08.661455+0000","last_active":"2024-05-14T15:17:10.104649+0000","last_peered":"2024-05-14T15:17:10.104649+0000","last_clean":"2024-05-14T15:17:10.104649+0000","last_became_active":"2024-05-14T15:17:08.661232+0000","last_became_peered":"2024-05-14T15:17:08.661232+0000","last_unstale":"2024-05-14T15:17:10.104649+0000","last_undegraded":"2024-05-14T15:17:10.104649+0000","last_fullsized":"2024-05-14T15:17:10.104649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:11:15.180771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.106239+0000","last_change":"2024-05-14T15:17:08.662640+0000","last_active":"2024-05-14T15:17:10.106239+0000","last_peered":"2024-05-14T15:17:10.106239+0000","last_clean":"2024-05-14T15:17:10.106239+0000","last_became_active":"2024-05-14T15:17:08.662015+0000","last_became_peered":"2024-05-14T15:17:08.662015+0000","last_unstale":"2024-05-14T15:17:10.106239+0000","last_undegraded":"2024-05-14T15:17:10.106239+0000","last_fullsized":"2024-05-14T15:17:10.106239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:55:35.430804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102662+0000","last_change":"2024-05-14T15:17:08.653825+0000","last_active":"2024-05-14T15:17:10.102662+0000","last_peered":"2024-05-14T15:17:10.102662+0000","last_clean":"2024-05-14T15:17:10.102662+0000","last_became_active":"2024-05-14T15:17:08.653495+0000","last_became_peered":"2024-05-14T15:17:08.653495+0000","last_unstale":"2024-05-14T15:17:10.102662+0000","last_undegraded":"2024-05-14T15:17:10.102662+0000","last_fullsized":"2024-05-14T15:17:10.102662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:30:06.095313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104021+0000","last_change":"2024-05-14T15:17:08.648038+0000","last_active":"2024-05-14T15:17:10.104021+0000","last_peered":"2024-05-14T15:17:10.104021+0000","last_clean":"2024-05-14T15:17:10.104021+0000","last_became_active":"2024-05-14T15:17:08.641958+0000","last_became_peered":"2024-05-14T15:17:08.641958+0000","last_unstale":"2024-05-14T15:17:10.104021+0000","last_undegraded":"2024-05-14T15:17:10.104021+0000","last_fullsized":"2024-05-14T15:17:10.104021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:24:57.017491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101294+0000","last_change":"2024-05-14T15:17:08.657379+0000","last_active":"2024-05-14T15:17:10.101294+0000","last_peered":"2024-05-14T15:17:10.101294+0000","last_clean":"2024-05-14T15:17:10.101294+0000","last_became_active":"2024-05-14T15:17:08.657034+0000","last_became_peered":"2024-05-14T15:17:08.657034+0000","last_unstale":"2024-05-14T15:17:10.101294+0000","last_undegraded":"2024-05-14T15:17:10.101294+0000","last_fullsized":"2024-05-14T15:17:10.101294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:11.051597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637199+0000","last_change":"2024-05-14T15:17:08.648283+0000","last_active":"2024-05-14T15:17:09.637199+0000","last_peered":"2024-05-14T15:17:09.637199+0000","last_clean":"2024-05-14T15:17:09.637199+0000","last_became_active":"2024-05-14T15:17:08.647923+0000","last_became_peered":"2024-05-14T15:17:08.647923+0000","last_unstale":"2024-05-14T15:17:09.637199+0000","last_undegraded":"2024-05-14T15:17:09.637199+0000","last_fullsized":"2024-05-14T15:17:09.637199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:28:35.937658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102317+0000","last_change":"2024-05-14T15:17:08.653672+0000","last_active":"2024-05-14T15:17:10.102317+0000","last_peered":"2024-05-14T15:17:10.102317+0000","last_clean":"2024-05-14T15:17:10.102317+0000","last_became_active":"2024-05-14T15:17:08.653390+0000","last_became_peered":"2024-05-14T15:17:08.653390+0000","last_unstale":"2024-05-14T15:17:10.102317+0000","last_undegraded":"2024-05-14T15:17:10.102317+0000","last_fullsized":"2024-05-14T15:17:10.102317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:14:55.308844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638991+0000","last_change":"2024-05-14T15:17:08.655118+0000","last_active":"2024-05-14T15:17:09.638991+0000","last_peered":"2024-05-14T15:17:09.638991+0000","last_clean":"2024-05-14T15:17:09.638991+0000","last_became_active":"2024-05-14T15:17:08.653462+0000","last_became_peered":"2024-05-14T15:17:08.653462+0000","last_unstale":"2024-05-14T15:17:09.638991+0000","last_undegraded":"2024-05-14T15:17:09.638991+0000","last_fullsized":"2024-05-14T15:17:09.638991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:08:17.087333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639393+0000","last_change":"2024-05-14T15:17:08.653265+0000","last_active":"2024-05-14T15:17:09.639393+0000","last_peered":"2024-05-14T15:17:09.639393+0000","last_clean":"2024-05-14T15:17:09.639393+0000","last_became_active":"2024-05-14T15:17:08.652466+0000","last_became_peered":"2024-05-14T15:17:08.652466+0000","last_unstale":"2024-05-14T15:17:09.639393+0000","last_undegraded":"2024-05-14T15:17:09.639393+0000","last_fullsized":"2024-05-14T15:17:09.639393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:16:44.349235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641647+0000","last_change":"2024-05-14T15:17:08.647147+0000","last_active":"2024-05-14T15:17:09.641647+0000","last_peered":"2024-05-14T15:17:09.641647+0000","last_clean":"2024-05-14T15:17:09.641647+0000","last_became_active":"2024-05-14T15:17:08.645346+0000","last_became_peered":"2024-05-14T15:17:08.645346+0000","last_unstale":"2024-05-14T15:17:09.641647+0000","last_undegraded":"2024-05-14T15:17:09.641647+0000","last_fullsized":"2024-05-14T15:17:09.641647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:20.337437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105631+0000","last_change":"2024-05-14T15:17:08.650198+0000","last_active":"2024-05-14T15:17:10.105631+0000","last_peered":"2024-05-14T15:17:10.105631+0000","last_clean":"2024-05-14T15:17:10.105631+0000","last_became_active":"2024-05-14T15:17:08.645447+0000","last_became_peered":"2024-05-14T15:17:08.645447+0000","last_unstale":"2024-05-14T15:17:10.105631+0000","last_undegraded":"2024-05-14T15:17:10.105631+0000","last_fullsized":"2024-05-14T15:17:10.105631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:03.804373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105414+0000","last_change":"2024-05-14T15:17:08.653078+0000","last_active":"2024-05-14T15:17:10.105414+0000","last_peered":"2024-05-14T15:17:10.105414+0000","last_clean":"2024-05-14T15:17:10.105414+0000","last_became_active":"2024-05-14T15:17:08.652749+0000","last_became_peered":"2024-05-14T15:17:08.652749+0000","last_unstale":"2024-05-14T15:17:10.105414+0000","last_undegraded":"2024-05-14T15:17:10.105414+0000","last_fullsized":"2024-05-14T15:17:10.105414+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:20.337437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105031+0000","last_change":"2024-05-14T15:17:08.631704+0000","last_active":"2024-05-14T15:17:10.105031+0000","last_peered":"2024-05-14T15:17:10.105031+0000","last_clean":"2024-05-14T15:17:10.105031+0000","last_became_active":"2024-05-14T15:17:08.631326+0000","last_became_peered":"2024-05-14T15:17:08.631326+0000","last_unstale":"2024-05-14T15:17:10.105031+0000","last_undegraded":"2024-05-14T15:17:10.105031+0000","last_fullsized":"2024-05-14T15:17:10.105031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:31:21.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637050+0000","last_change":"2024-05-14T15:17:08.642316+0000","last_active":"2024-05-14T15:17:09.637050+0000","last_peered":"2024-05-14T15:17:09.637050+0000","last_clean":"2024-05-14T15:17:09.637050+0000","last_became_active":"2024-05-14T15:17:08.641774+0000","last_became_peered":"2024-05-14T15:17:08.641774+0000","last_unstale":"2024-05-14T15:17:09.637050+0000","last_undegraded":"2024-05-14T15:17:09.637050+0000","last_fullsized":"2024-05-14T15:17:09.637050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:00.843505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640838+0000","last_change":"2024-05-14T15:17:08.642606+0000","last_active":"2024-05-14T15:17:09.640838+0000","last_peered":"2024-05-14T15:17:09.640838+0000","last_clean":"2024-05-14T15:17:09.640838+0000","last_became_active":"2024-05-14T15:17:08.642205+0000","last_became_peered":"2024-05-14T15:17:08.642205+0000","last_unstale":"2024-05-14T15:17:09.640838+0000","last_undegraded":"2024-05-14T15:17:09.640838+0000","last_fullsized":"2024-05-14T15:17:09.640838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:43:48.024255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103357+0000","last_change":"2024-05-14T15:17:08.630763+0000","last_active":"2024-05-14T15:17:10.103357+0000","last_peered":"2024-05-14T15:17:10.103357+0000","last_clean":"2024-05-14T15:17:10.103357+0000","last_became_active":"2024-05-14T15:17:08.630442+0000","last_became_peered":"2024-05-14T15:17:08.630442+0000","last_unstale":"2024-05-14T15:17:10.103357+0000","last_undegraded":"2024-05-14T15:17:10.103357+0000","last_fullsized":"2024-05-14T15:17:10.103357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:24:57.017491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643620+0000","last_change":"2024-05-14T15:17:08.658567+0000","last_active":"2024-05-14T15:17:09.643620+0000","last_peered":"2024-05-14T15:17:09.643620+0000","last_clean":"2024-05-14T15:17:09.643620+0000","last_became_active":"2024-05-14T15:17:08.658203+0000","last_became_peered":"2024-05-14T15:17:08.658203+0000","last_unstale":"2024-05-14T15:17:09.643620+0000","last_undegraded":"2024-05-14T15:17:09.643620+0000","last_fullsized":"2024-05-14T15:17:09.643620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:39.935648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.106111+0000","last_change":"2024-05-14T15:17:08.637491+0000","last_active":"2024-05-14T15:17:10.106111+0000","last_peered":"2024-05-14T15:17:10.106111+0000","last_clean":"2024-05-14T15:17:10.106111+0000","last_became_active":"2024-05-14T15:17:08.637158+0000","last_became_peered":"2024-05-14T15:17:08.637158+0000","last_unstale":"2024-05-14T15:17:10.106111+0000","last_undegraded":"2024-05-14T15:17:10.106111+0000","last_fullsized":"2024-05-14T15:17:10.106111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:30:17.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104248+0000","last_change":"2024-05-14T15:17:08.654866+0000","last_active":"2024-05-14T15:17:10.104248+0000","last_peered":"2024-05-14T15:17:10.104248+0000","last_clean":"2024-05-14T15:17:10.104248+0000","last_became_active":"2024-05-14T15:17:08.654517+0000","last_became_peered":"2024-05-14T15:17:08.654517+0000","last_unstale":"2024-05-14T15:17:10.104248+0000","last_undegraded":"2024-05-14T15:17:10.104248+0000","last_fullsized":"2024-05-14T15:17:10.104248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:27:46.422523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637973+0000","last_change":"2024-05-14T15:17:08.643450+0000","last_active":"2024-05-14T15:17:09.637973+0000","last_peered":"2024-05-14T15:17:09.637973+0000","last_clean":"2024-05-14T15:17:09.637973+0000","last_became_active":"2024-05-14T15:17:08.643101+0000","last_became_peered":"2024-05-14T15:17:08.643101+0000","last_unstale":"2024-05-14T15:17:09.637973+0000","last_undegraded":"2024-05-14T15:17:09.637973+0000","last_fullsized":"2024-05-14T15:17:09.637973+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:36.558191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638099+0000","last_change":"2024-05-14T15:17:08.649250+0000","last_active":"2024-05-14T15:17:09.638099+0000","last_peered":"2024-05-14T15:17:09.638099+0000","last_clean":"2024-05-14T15:17:09.638099+0000","last_became_active":"2024-05-14T15:17:08.648958+0000","last_became_peered":"2024-05-14T15:17:08.648958+0000","last_unstale":"2024-05-14T15:17:09.638099+0000","last_undegraded":"2024-05-14T15:17:09.638099+0000","last_fullsized":"2024-05-14T15:17:09.638099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:04:24.936924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102730+0000","last_change":"2024-05-14T15:17:08.644705+0000","last_active":"2024-05-14T15:17:10.102730+0000","last_peered":"2024-05-14T15:17:10.102730+0000","last_clean":"2024-05-14T15:17:10.102730+0000","last_became_active":"2024-05-14T15:17:08.644408+0000","last_became_peered":"2024-05-14T15:17:08.644408+0000","last_unstale":"2024-05-14T15:17:10.102730+0000","last_undegraded":"2024-05-14T15:17:10.102730+0000","last_fullsized":"2024-05-14T15:17:10.102730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:09:06.196387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641293+0000","last_change":"2024-05-14T15:17:08.651771+0000","last_active":"2024-05-14T15:17:09.641293+0000","last_peered":"2024-05-14T15:17:09.641293+0000","last_clean":"2024-05-14T15:17:09.641293+0000","last_became_active":"2024-05-14T15:17:08.651447+0000","last_became_peered":"2024-05-14T15:17:08.651447+0000","last_unstale":"2024-05-14T15:17:09.641293+0000","last_undegraded":"2024-05-14T15:17:09.641293+0000","last_fullsized":"2024-05-14T15:17:09.641293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:01:17.311128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639035+0000","last_change":"2024-05-14T15:17:08.654014+0000","last_active":"2024-05-14T15:17:09.639035+0000","last_peered":"2024-05-14T15:17:09.639035+0000","last_clean":"2024-05-14T15:17:09.639035+0000","last_became_active":"2024-05-14T15:17:08.648263+0000","last_became_peered":"2024-05-14T15:17:08.648263+0000","last_unstale":"2024-05-14T15:17:09.639035+0000","last_undegraded":"2024-05-14T15:17:09.639035+0000","last_fullsized":"2024-05-14T15:17:09.639035+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:29.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103356+0000","last_change":"2024-05-14T15:17:07.605019+0000","last_active":"2024-05-14T15:17:10.103356+0000","last_peered":"2024-05-14T15:17:10.103356+0000","last_clean":"2024-05-14T15:17:10.103356+0000","last_became_active":"2024-05-14T15:17:07.604634+0000","last_became_peered":"2024-05-14T15:17:07.604634+0000","last_unstale":"2024-05-14T15:17:10.103356+0000","last_undegraded":"2024-05-14T15:17:10.103356+0000","last_fullsized":"2024-05-14T15:17:10.103356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:30:05.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101751+0000","last_change":"2024-05-14T15:17:08.646560+0000","last_active":"2024-05-14T15:17:10.101751+0000","last_peered":"2024-05-14T15:17:10.101751+0000","last_clean":"2024-05-14T15:17:10.101751+0000","last_became_active":"2024-05-14T15:17:08.645839+0000","last_became_peered":"2024-05-14T15:17:08.645839+0000","last_unstale":"2024-05-14T15:17:10.101751+0000","last_undegraded":"2024-05-14T15:17:10.101751+0000","last_fullsized":"2024-05-14T15:17:10.101751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:27:02.995737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103179+0000","last_change":"2024-05-14T15:17:07.619947+0000","last_active":"2024-05-14T15:17:10.103179+0000","last_peered":"2024-05-14T15:17:10.103179+0000","last_clean":"2024-05-14T15:17:10.103179+0000","last_became_active":"2024-05-14T15:17:07.619620+0000","last_became_peered":"2024-05-14T15:17:07.619620+0000","last_unstale":"2024-05-14T15:17:10.103179+0000","last_undegraded":"2024-05-14T15:17:10.103179+0000","last_fullsized":"2024-05-14T15:17:10.103179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:30:05.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639507+0000","last_change":"2024-05-14T15:17:08.652959+0000","last_active":"2024-05-14T15:17:09.639507+0000","last_peered":"2024-05-14T15:17:09.639507+0000","last_clean":"2024-05-14T15:17:09.639507+0000","last_became_active":"2024-05-14T15:17:08.652027+0000","last_became_peered":"2024-05-14T15:17:08.652027+0000","last_unstale":"2024-05-14T15:17:09.639507+0000","last_undegraded":"2024-05-14T15:17:09.639507+0000","last_fullsized":"2024-05-14T15:17:09.639507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:46.108541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.644187+0000","last_change":"2024-05-14T15:17:07.621366+0000","last_active":"2024-05-14T15:17:09.644187+0000","last_peered":"2024-05-14T15:17:09.644187+0000","last_clean":"2024-05-14T15:17:09.644187+0000","last_became_active":"2024-05-14T15:17:07.621050+0000","last_became_peered":"2024-05-14T15:17:07.621050+0000","last_unstale":"2024-05-14T15:17:09.644187+0000","last_undegraded":"2024-05-14T15:17:09.644187+0000","last_fullsized":"2024-05-14T15:17:09.644187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:03:24.803952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102570+0000","last_change":"2024-05-14T15:17:08.649247+0000","last_active":"2024-05-14T15:17:10.102570+0000","last_peered":"2024-05-14T15:17:10.102570+0000","last_clean":"2024-05-14T15:17:10.102570+0000","last_became_active":"2024-05-14T15:17:08.645433+0000","last_became_peered":"2024-05-14T15:17:08.645433+0000","last_unstale":"2024-05-14T15:17:10.102570+0000","last_undegraded":"2024-05-14T15:17:10.102570+0000","last_fullsized":"2024-05-14T15:17:10.102570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:20.337437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104196+0000","last_change":"2024-05-14T15:17:07.603097+0000","last_active":"2024-05-14T15:17:10.104196+0000","last_peered":"2024-05-14T15:17:10.104196+0000","last_clean":"2024-05-14T15:17:10.104196+0000","last_became_active":"2024-05-14T15:17:07.602732+0000","last_became_peered":"2024-05-14T15:17:07.602732+0000","last_unstale":"2024-05-14T15:17:10.104196+0000","last_undegraded":"2024-05-14T15:17:10.104196+0000","last_fullsized":"2024-05-14T15:17:10.104196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:14.267105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641944+0000","last_change":"2024-05-14T15:17:08.641813+0000","last_active":"2024-05-14T15:17:09.641944+0000","last_peered":"2024-05-14T15:17:09.641944+0000","last_clean":"2024-05-14T15:17:09.641944+0000","last_became_active":"2024-05-14T15:17:08.641312+0000","last_became_peered":"2024-05-14T15:17:08.641312+0000","last_unstale":"2024-05-14T15:17:09.641944+0000","last_undegraded":"2024-05-14T15:17:09.641944+0000","last_fullsized":"2024-05-14T15:17:09.641944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:50:16.123030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102615+0000","last_change":"2024-05-14T15:17:07.615137+0000","last_active":"2024-05-14T15:17:10.102615+0000","last_peered":"2024-05-14T15:17:10.102615+0000","last_clean":"2024-05-14T15:17:10.102615+0000","last_became_active":"2024-05-14T15:17:07.614667+0000","last_became_peered":"2024-05-14T15:17:07.614667+0000","last_unstale":"2024-05-14T15:17:10.102615+0000","last_undegraded":"2024-05-14T15:17:10.102615+0000","last_fullsized":"2024-05-14T15:17:10.102615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:44:04.709006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103606+0000","last_change":"2024-05-14T15:17:08.630027+0000","last_active":"2024-05-14T15:17:10.103606+0000","last_peered":"2024-05-14T15:17:10.103606+0000","last_clean":"2024-05-14T15:17:10.103606+0000","last_became_active":"2024-05-14T15:17:08.629554+0000","last_became_peered":"2024-05-14T15:17:08.629554+0000","last_unstale":"2024-05-14T15:17:10.103606+0000","last_undegraded":"2024-05-14T15:17:10.103606+0000","last_fullsized":"2024-05-14T15:17:10.103606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:27:02.995737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103210+0000","last_change":"2024-05-14T15:17:07.611113+0000","last_active":"2024-05-14T15:17:10.103210+0000","last_peered":"2024-05-14T15:17:10.103210+0000","last_clean":"2024-05-14T15:17:10.103210+0000","last_became_active":"2024-05-14T15:17:07.610830+0000","last_became_peered":"2024-05-14T15:17:07.610830+0000","last_unstale":"2024-05-14T15:17:10.103210+0000","last_undegraded":"2024-05-14T15:17:10.103210+0000","last_fullsized":"2024-05-14T15:17:10.103210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:47:09.539116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637502+0000","last_change":"2024-05-14T15:17:08.656770+0000","last_active":"2024-05-14T15:17:09.637502+0000","last_peered":"2024-05-14T15:17:09.637502+0000","last_clean":"2024-05-14T15:17:09.637502+0000","last_became_active":"2024-05-14T15:17:08.655687+0000","last_became_peered":"2024-05-14T15:17:08.655687+0000","last_unstale":"2024-05-14T15:17:09.637502+0000","last_undegraded":"2024-05-14T15:17:09.637502+0000","last_fullsized":"2024-05-14T15:17:09.637502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:25:57.076989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641854+0000","last_change":"2024-05-14T15:17:07.615293+0000","last_active":"2024-05-14T15:17:09.641854+0000","last_peered":"2024-05-14T15:17:09.641854+0000","last_clean":"2024-05-14T15:17:09.641854+0000","last_became_active":"2024-05-14T15:17:07.614859+0000","last_became_peered":"2024-05-14T15:17:07.614859+0000","last_unstale":"2024-05-14T15:17:09.641854+0000","last_undegraded":"2024-05-14T15:17:09.641854+0000","last_fullsized":"2024-05-14T15:17:09.641854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:16.343961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101996+0000","last_change":"2024-05-14T15:17:08.625897+0000","last_active":"2024-05-14T15:17:10.101996+0000","last_peered":"2024-05-14T15:17:10.101996+0000","last_clean":"2024-05-14T15:17:10.101996+0000","last_became_active":"2024-05-14T15:17:08.625476+0000","last_became_peered":"2024-05-14T15:17:08.625476+0000","last_unstale":"2024-05-14T15:17:10.101996+0000","last_undegraded":"2024-05-14T15:17:10.101996+0000","last_fullsized":"2024-05-14T15:17:10.101996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:28:37.586671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101159+0000","last_change":"2024-05-14T15:17:07.619899+0000","last_active":"2024-05-14T15:17:10.101159+0000","last_peered":"2024-05-14T15:17:10.101159+0000","last_clean":"2024-05-14T15:17:10.101159+0000","last_became_active":"2024-05-14T15:17:07.619090+0000","last_became_peered":"2024-05-14T15:17:07.619090+0000","last_unstale":"2024-05-14T15:17:10.101159+0000","last_undegraded":"2024-05-14T15:17:10.101159+0000","last_fullsized":"2024-05-14T15:17:10.101159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:26:03.445798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643255+0000","last_change":"2024-05-14T15:17:08.646517+0000","last_active":"2024-05-14T15:17:09.643255+0000","last_peered":"2024-05-14T15:17:09.643255+0000","last_clean":"2024-05-14T15:17:09.643255+0000","last_became_active":"2024-05-14T15:17:08.645258+0000","last_became_peered":"2024-05-14T15:17:08.645258+0000","last_unstale":"2024-05-14T15:17:09.643255+0000","last_undegraded":"2024-05-14T15:17:09.643255+0000","last_fullsized":"2024-05-14T15:17:09.643255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:11:17.538195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643984+0000","last_change":"2024-05-14T15:17:07.607732+0000","last_active":"2024-05-14T15:17:09.643984+0000","last_peered":"2024-05-14T15:17:09.643984+0000","last_clean":"2024-05-14T15:17:09.643984+0000","last_became_active":"2024-05-14T15:17:07.607356+0000","last_became_peered":"2024-05-14T15:17:07.607356+0000","last_unstale":"2024-05-14T15:17:09.643984+0000","last_undegraded":"2024-05-14T15:17:09.643984+0000","last_fullsized":"2024-05-14T15:17:09.643984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:04:57.456664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103520+0000","last_change":"2024-05-14T15:17:08.644658+0000","last_active":"2024-05-14T15:17:10.103520+0000","last_peered":"2024-05-14T15:17:10.103520+0000","last_clean":"2024-05-14T15:17:10.103520+0000","last_became_active":"2024-05-14T15:17:08.644274+0000","last_became_peered":"2024-05-14T15:17:08.644274+0000","last_unstale":"2024-05-14T15:17:10.103520+0000","last_undegraded":"2024-05-14T15:17:10.103520+0000","last_fullsized":"2024-05-14T15:17:10.103520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:27:46.422523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639095+0000","last_change":"2024-05-14T15:17:07.623881+0000","last_active":"2024-05-14T15:17:09.639095+0000","last_peered":"2024-05-14T15:17:09.639095+0000","last_clean":"2024-05-14T15:17:09.639095+0000","last_became_active":"2024-05-14T15:17:07.623479+0000","last_became_peered":"2024-05-14T15:17:07.623479+0000","last_unstale":"2024-05-14T15:17:09.639095+0000","last_undegraded":"2024-05-14T15:17:09.639095+0000","last_fullsized":"2024-05-14T15:17:09.639095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:07:19.650319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.644014+0000","last_change":"2024-05-14T15:17:08.663164+0000","last_active":"2024-05-14T15:17:09.644014+0000","last_peered":"2024-05-14T15:17:09.644014+0000","last_clean":"2024-05-14T15:17:09.644014+0000","last_became_active":"2024-05-14T15:17:08.662883+0000","last_became_peered":"2024-05-14T15:17:08.662883+0000","last_unstale":"2024-05-14T15:17:09.644014+0000","last_undegraded":"2024-05-14T15:17:09.644014+0000","last_fullsized":"2024-05-14T15:17:09.644014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:04:59.926808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638305+0000","last_change":"2024-05-14T15:17:07.611569+0000","last_active":"2024-05-14T15:17:09.638305+0000","last_peered":"2024-05-14T15:17:09.638305+0000","last_clean":"2024-05-14T15:17:09.638305+0000","last_became_active":"2024-05-14T15:17:07.610204+0000","last_became_peered":"2024-05-14T15:17:07.610204+0000","last_unstale":"2024-05-14T15:17:09.638305+0000","last_undegraded":"2024-05-14T15:17:09.638305+0000","last_fullsized":"2024-05-14T15:17:09.638305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:24:28.381510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102507+0000","last_change":"2024-05-14T15:17:08.647571+0000","last_active":"2024-05-14T15:17:10.102507+0000","last_peered":"2024-05-14T15:17:10.102507+0000","last_clean":"2024-05-14T15:17:10.102507+0000","last_became_active":"2024-05-14T15:17:08.647392+0000","last_became_peered":"2024-05-14T15:17:08.647392+0000","last_unstale":"2024-05-14T15:17:10.102507+0000","last_undegraded":"2024-05-14T15:17:10.102507+0000","last_fullsized":"2024-05-14T15:17:10.102507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:22:29.589313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.643598+0000","last_change":"2024-05-14T15:17:07.613118+0000","last_active":"2024-05-14T15:17:09.643598+0000","last_peered":"2024-05-14T15:17:09.643598+0000","last_clean":"2024-05-14T15:17:09.643598+0000","last_became_active":"2024-05-14T15:17:07.612479+0000","last_became_peered":"2024-05-14T15:17:07.612479+0000","last_unstale":"2024-05-14T15:17:09.643598+0000","last_undegraded":"2024-05-14T15:17:09.643598+0000","last_fullsized":"2024-05-14T15:17:09.643598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:10:07.348206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.642490+0000","last_change":"2024-05-14T15:17:08.644491+0000","last_active":"2024-05-14T15:17:09.642490+0000","last_peered":"2024-05-14T15:17:09.642490+0000","last_clean":"2024-05-14T15:17:09.642490+0000","last_became_active":"2024-05-14T15:17:08.641265+0000","last_became_peered":"2024-05-14T15:17:08.641265+0000","last_unstale":"2024-05-14T15:17:09.642490+0000","last_undegraded":"2024-05-14T15:17:09.642490+0000","last_fullsized":"2024-05-14T15:17:09.642490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:23:29.937899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640879+0000","last_change":"2024-05-14T15:17:07.620315+0000","last_active":"2024-05-14T15:17:09.640879+0000","last_peered":"2024-05-14T15:17:09.640879+0000","last_clean":"2024-05-14T15:17:09.640879+0000","last_became_active":"2024-05-14T15:17:07.619996+0000","last_became_peered":"2024-05-14T15:17:07.619996+0000","last_unstale":"2024-05-14T15:17:09.640879+0000","last_undegraded":"2024-05-14T15:17:09.640879+0000","last_fullsized":"2024-05-14T15:17:09.640879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:30.104835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101326+0000","last_change":"2024-05-14T15:17:08.651255+0000","last_active":"2024-05-14T15:17:10.101326+0000","last_peered":"2024-05-14T15:17:10.101326+0000","last_clean":"2024-05-14T15:17:10.101326+0000","last_became_active":"2024-05-14T15:17:08.650108+0000","last_became_peered":"2024-05-14T15:17:08.650108+0000","last_unstale":"2024-05-14T15:17:10.101326+0000","last_undegraded":"2024-05-14T15:17:10.101326+0000","last_fullsized":"2024-05-14T15:17:10.101326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:55:49.925615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101733+0000","last_change":"2024-05-14T15:17:07.621657+0000","last_active":"2024-05-14T15:17:10.101733+0000","last_peered":"2024-05-14T15:17:10.101733+0000","last_clean":"2024-05-14T15:17:10.101733+0000","last_became_active":"2024-05-14T15:17:07.621298+0000","last_became_peered":"2024-05-14T15:17:07.621298+0000","last_unstale":"2024-05-14T15:17:10.101733+0000","last_undegraded":"2024-05-14T15:17:10.101733+0000","last_fullsized":"2024-05-14T15:17:10.101733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:14.267105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105232+0000","last_change":"2024-05-14T15:17:08.646544+0000","last_active":"2024-05-14T15:17:10.105232+0000","last_peered":"2024-05-14T15:17:10.105232+0000","last_clean":"2024-05-14T15:17:10.105232+0000","last_became_active":"2024-05-14T15:17:08.646205+0000","last_became_peered":"2024-05-14T15:17:08.646205+0000","last_unstale":"2024-05-14T15:17:10.105232+0000","last_undegraded":"2024-05-14T15:17:10.105232+0000","last_fullsized":"2024-05-14T15:17:10.105232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:28:37.586671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637218+0000","last_change":"2024-05-14T15:17:07.611460+0000","last_active":"2024-05-14T15:17:09.637218+0000","last_peered":"2024-05-14T15:17:09.637218+0000","last_clean":"2024-05-14T15:17:09.637218+0000","last_became_active":"2024-05-14T15:17:07.609712+0000","last_became_peered":"2024-05-14T15:17:07.609712+0000","last_unstale":"2024-05-14T15:17:09.637218+0000","last_undegraded":"2024-05-14T15:17:09.637218+0000","last_fullsized":"2024-05-14T15:17:09.637218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:30:20.668756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102739+0000","last_change":"2024-05-14T15:17:08.649411+0000","last_active":"2024-05-14T15:17:10.102739+0000","last_peered":"2024-05-14T15:17:10.102739+0000","last_clean":"2024-05-14T15:17:10.102739+0000","last_became_active":"2024-05-14T15:17:08.648336+0000","last_became_peered":"2024-05-14T15:17:08.648336+0000","last_unstale":"2024-05-14T15:17:10.102739+0000","last_undegraded":"2024-05-14T15:17:10.102739+0000","last_fullsized":"2024-05-14T15:17:10.102739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:22:29.589313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101634+0000","last_change":"2024-05-14T15:17:07.607917+0000","last_active":"2024-05-14T15:17:10.101634+0000","last_peered":"2024-05-14T15:17:10.101634+0000","last_clean":"2024-05-14T15:17:10.101634+0000","last_became_active":"2024-05-14T15:17:07.607523+0000","last_became_peered":"2024-05-14T15:17:07.607523+0000","last_unstale":"2024-05-14T15:17:10.101634+0000","last_undegraded":"2024-05-14T15:17:10.101634+0000","last_fullsized":"2024-05-14T15:17:10.101634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:06:22.038696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102878+0000","last_change":"2024-05-14T15:17:08.651593+0000","last_active":"2024-05-14T15:17:10.102878+0000","last_peered":"2024-05-14T15:17:10.102878+0000","last_clean":"2024-05-14T15:17:10.102878+0000","last_became_active":"2024-05-14T15:17:08.650086+0000","last_became_peered":"2024-05-14T15:17:08.650086+0000","last_unstale":"2024-05-14T15:17:10.102878+0000","last_undegraded":"2024-05-14T15:17:10.102878+0000","last_fullsized":"2024-05-14T15:17:10.102878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:21:03.804373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102681+0000","last_change":"2024-05-14T15:17:07.609082+0000","last_active":"2024-05-14T15:17:10.102681+0000","last_peered":"2024-05-14T15:17:10.102681+0000","last_clean":"2024-05-14T15:17:10.102681+0000","last_became_active":"2024-05-14T15:17:07.608766+0000","last_became_peered":"2024-05-14T15:17:07.608766+0000","last_unstale":"2024-05-14T15:17:10.102681+0000","last_undegraded":"2024-05-14T15:17:10.102681+0000","last_fullsized":"2024-05-14T15:17:10.102681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:06:46.462960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104549+0000","last_change":"2024-05-14T15:17:08.652457+0000","last_active":"2024-05-14T15:17:10.104549+0000","last_peered":"2024-05-14T15:17:10.104549+0000","last_clean":"2024-05-14T15:17:10.104549+0000","last_became_active":"2024-05-14T15:17:08.652132+0000","last_became_peered":"2024-05-14T15:17:08.652132+0000","last_unstale":"2024-05-14T15:17:10.104549+0000","last_undegraded":"2024-05-14T15:17:10.104549+0000","last_fullsized":"2024-05-14T15:17:10.104549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:07.116826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639550+0000","last_change":"2024-05-14T15:17:07.610533+0000","last_active":"2024-05-14T15:17:09.639550+0000","last_peered":"2024-05-14T15:17:09.639550+0000","last_clean":"2024-05-14T15:17:09.639550+0000","last_became_active":"2024-05-14T15:17:07.610061+0000","last_became_peered":"2024-05-14T15:17:07.610061+0000","last_unstale":"2024-05-14T15:17:09.639550+0000","last_undegraded":"2024-05-14T15:17:09.639550+0000","last_fullsized":"2024-05-14T15:17:09.639550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:35:46.645743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.104780+0000","last_change":"2024-05-14T15:17:08.648896+0000","last_active":"2024-05-14T15:17:10.104780+0000","last_peered":"2024-05-14T15:17:10.104780+0000","last_clean":"2024-05-14T15:17:10.104780+0000","last_became_active":"2024-05-14T15:17:08.648498+0000","last_became_peered":"2024-05-14T15:17:08.648498+0000","last_unstale":"2024-05-14T15:17:10.104780+0000","last_undegraded":"2024-05-14T15:17:10.104780+0000","last_fullsized":"2024-05-14T15:17:10.104780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:46:53.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103061+0000","last_change":"2024-05-14T15:17:07.623527+0000","last_active":"2024-05-14T15:17:10.103061+0000","last_peered":"2024-05-14T15:17:10.103061+0000","last_clean":"2024-05-14T15:17:10.103061+0000","last_became_active":"2024-05-14T15:17:07.622867+0000","last_became_peered":"2024-05-14T15:17:07.622867+0000","last_unstale":"2024-05-14T15:17:10.103061+0000","last_undegraded":"2024-05-14T15:17:10.103061+0000","last_fullsized":"2024-05-14T15:17:10.103061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:06:46.462960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640978+0000","last_change":"2024-05-14T15:17:08.644712+0000","last_active":"2024-05-14T15:17:09.640978+0000","last_peered":"2024-05-14T15:17:09.640978+0000","last_clean":"2024-05-14T15:17:09.640978+0000","last_became_active":"2024-05-14T15:17:08.644410+0000","last_became_peered":"2024-05-14T15:17:08.644410+0000","last_unstale":"2024-05-14T15:17:09.640978+0000","last_undegraded":"2024-05-14T15:17:09.640978+0000","last_fullsized":"2024-05-14T15:17:09.640978+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:03.770193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640346+0000","last_change":"2024-05-14T15:17:07.611088+0000","last_active":"2024-05-14T15:17:09.640346+0000","last_peered":"2024-05-14T15:17:09.640346+0000","last_clean":"2024-05-14T15:17:09.640346+0000","last_became_active":"2024-05-14T15:17:07.610766+0000","last_became_peered":"2024-05-14T15:17:07.610766+0000","last_unstale":"2024-05-14T15:17:09.640346+0000","last_undegraded":"2024-05-14T15:17:09.640346+0000","last_fullsized":"2024-05-14T15:17:09.640346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:46:52.723786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637222+0000","last_change":"2024-05-14T15:17:08.649932+0000","last_active":"2024-05-14T15:17:09.637222+0000","last_peered":"2024-05-14T15:17:09.637222+0000","last_clean":"2024-05-14T15:17:09.637222+0000","last_became_active":"2024-05-14T15:17:08.649621+0000","last_became_peered":"2024-05-14T15:17:08.649621+0000","last_unstale":"2024-05-14T15:17:09.637222+0000","last_undegraded":"2024-05-14T15:17:09.637222+0000","last_fullsized":"2024-05-14T15:17:09.637222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:11.681650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640086+0000","last_change":"2024-05-14T15:17:07.616688+0000","last_active":"2024-05-14T15:17:09.640086+0000","last_peered":"2024-05-14T15:17:09.640086+0000","last_clean":"2024-05-14T15:17:09.640086+0000","last_became_active":"2024-05-14T15:17:07.616347+0000","last_became_peered":"2024-05-14T15:17:07.616347+0000","last_unstale":"2024-05-14T15:17:09.640086+0000","last_undegraded":"2024-05-14T15:17:09.640086+0000","last_fullsized":"2024-05-14T15:17:09.640086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:49:01.041123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.641751+0000","last_change":"2024-05-14T15:17:08.660666+0000","last_active":"2024-05-14T15:17:09.641751+0000","last_peered":"2024-05-14T15:17:09.641751+0000","last_clean":"2024-05-14T15:17:09.641751+0000","last_became_active":"2024-05-14T15:17:08.660282+0000","last_became_peered":"2024-05-14T15:17:08.660282+0000","last_unstale":"2024-05-14T15:17:09.641751+0000","last_undegraded":"2024-05-14T15:17:09.641751+0000","last_fullsized":"2024-05-14T15:17:09.641751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:11:45.458618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102015+0000","last_change":"2024-05-14T15:17:07.621928+0000","last_active":"2024-05-14T15:17:10.102015+0000","last_peered":"2024-05-14T15:17:10.102015+0000","last_clean":"2024-05-14T15:17:10.102015+0000","last_became_active":"2024-05-14T15:17:07.621606+0000","last_became_peered":"2024-05-14T15:17:07.621606+0000","last_unstale":"2024-05-14T15:17:10.102015+0000","last_undegraded":"2024-05-14T15:17:10.102015+0000","last_fullsized":"2024-05-14T15:17:10.102015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:14:54.292306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105299+0000","last_change":"2024-05-14T15:17:08.662009+0000","last_active":"2024-05-14T15:17:10.105299+0000","last_peered":"2024-05-14T15:17:10.105299+0000","last_clean":"2024-05-14T15:17:10.105299+0000","last_became_active":"2024-05-14T15:17:08.661595+0000","last_became_peered":"2024-05-14T15:17:08.661595+0000","last_unstale":"2024-05-14T15:17:10.105299+0000","last_undegraded":"2024-05-14T15:17:10.105299+0000","last_fullsized":"2024-05-14T15:17:10.105299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:03.770193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.102884+0000","last_change":"2024-05-14T15:17:07.618153+0000","last_active":"2024-05-14T15:17:10.102884+0000","last_peered":"2024-05-14T15:17:10.102884+0000","last_clean":"2024-05-14T15:17:10.102884+0000","last_became_active":"2024-05-14T15:17:07.612460+0000","last_became_peered":"2024-05-14T15:17:07.612460+0000","last_unstale":"2024-05-14T15:17:10.102884+0000","last_undegraded":"2024-05-14T15:17:10.102884+0000","last_fullsized":"2024-05-14T15:17:10.102884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:51:38.180762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640571+0000","last_change":"2024-05-14T15:17:08.651512+0000","last_active":"2024-05-14T15:17:09.640571+0000","last_peered":"2024-05-14T15:17:09.640571+0000","last_clean":"2024-05-14T15:17:09.640571+0000","last_became_active":"2024-05-14T15:17:08.651177+0000","last_became_peered":"2024-05-14T15:17:08.651177+0000","last_unstale":"2024-05-14T15:17:09.640571+0000","last_undegraded":"2024-05-14T15:17:09.640571+0000","last_fullsized":"2024-05-14T15:17:09.640571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:09:33.272092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.100635+0000","last_change":"2024-05-14T15:17:07.620245+0000","last_active":"2024-05-14T15:17:10.100635+0000","last_peered":"2024-05-14T15:17:10.100635+0000","last_clean":"2024-05-14T15:17:10.100635+0000","last_became_active":"2024-05-14T15:17:07.619098+0000","last_became_peered":"2024-05-14T15:17:07.619098+0000","last_unstale":"2024-05-14T15:17:10.100635+0000","last_undegraded":"2024-05-14T15:17:10.100635+0000","last_fullsized":"2024-05-14T15:17:10.100635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:06:22.038696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103381+0000","last_change":"2024-05-14T15:17:08.661547+0000","last_active":"2024-05-14T15:17:10.103381+0000","last_peered":"2024-05-14T15:17:10.103381+0000","last_clean":"2024-05-14T15:17:10.103381+0000","last_became_active":"2024-05-14T15:17:08.661192+0000","last_became_peered":"2024-05-14T15:17:08.661192+0000","last_unstale":"2024-05-14T15:17:10.103381+0000","last_undegraded":"2024-05-14T15:17:10.103381+0000","last_fullsized":"2024-05-14T15:17:10.103381+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:09:06.196387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639058+0000","last_change":"2024-05-14T15:17:07.619456+0000","last_active":"2024-05-14T15:17:09.639058+0000","last_peered":"2024-05-14T15:17:09.639058+0000","last_clean":"2024-05-14T15:17:09.639058+0000","last_became_active":"2024-05-14T15:17:07.619106+0000","last_became_peered":"2024-05-14T15:17:07.619106+0000","last_unstale":"2024-05-14T15:17:09.639058+0000","last_undegraded":"2024-05-14T15:17:09.639058+0000","last_fullsized":"2024-05-14T15:17:09.639058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:37:58.907748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.106440+0000","last_change":"2024-05-14T15:17:08.661902+0000","last_active":"2024-05-14T15:17:10.106440+0000","last_peered":"2024-05-14T15:17:10.106440+0000","last_clean":"2024-05-14T15:17:10.106440+0000","last_became_active":"2024-05-14T15:17:08.661555+0000","last_became_peered":"2024-05-14T15:17:08.661555+0000","last_unstale":"2024-05-14T15:17:10.106440+0000","last_undegraded":"2024-05-14T15:17:10.106440+0000","last_fullsized":"2024-05-14T15:17:10.106440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:01:48.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103883+0000","last_change":"2024-05-14T15:17:07.621675+0000","last_active":"2024-05-14T15:17:10.103883+0000","last_peered":"2024-05-14T15:17:10.103883+0000","last_clean":"2024-05-14T15:17:10.103883+0000","last_became_active":"2024-05-14T15:17:07.621351+0000","last_became_peered":"2024-05-14T15:17:07.621351+0000","last_unstale":"2024-05-14T15:17:10.103883+0000","last_undegraded":"2024-05-14T15:17:10.103883+0000","last_fullsized":"2024-05-14T15:17:10.103883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:47:09.539116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.640174+0000","last_change":"2024-05-14T15:17:08.644025+0000","last_active":"2024-05-14T15:17:09.640174+0000","last_peered":"2024-05-14T15:17:09.640174+0000","last_clean":"2024-05-14T15:17:09.640174+0000","last_became_active":"2024-05-14T15:17:08.643642+0000","last_became_peered":"2024-05-14T15:17:08.643642+0000","last_unstale":"2024-05-14T15:17:09.640174+0000","last_undegraded":"2024-05-14T15:17:09.640174+0000","last_fullsized":"2024-05-14T15:17:09.640174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:28:37.586671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.103638+0000","last_change":"2024-05-14T15:17:07.623764+0000","last_active":"2024-05-14T15:17:10.103638+0000","last_peered":"2024-05-14T15:17:10.103638+0000","last_clean":"2024-05-14T15:17:10.103638+0000","last_became_active":"2024-05-14T15:17:07.623325+0000","last_became_peered":"2024-05-14T15:17:07.623325+0000","last_unstale":"2024-05-14T15:17:10.103638+0000","last_undegraded":"2024-05-14T15:17:10.103638+0000","last_fullsized":"2024-05-14T15:17:10.103638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:05.248283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101453+0000","last_change":"2024-05-14T15:17:08.652293+0000","last_active":"2024-05-14T15:17:10.101453+0000","last_peered":"2024-05-14T15:17:10.101453+0000","last_clean":"2024-05-14T15:17:10.101453+0000","last_became_active":"2024-05-14T15:17:08.651896+0000","last_became_peered":"2024-05-14T15:17:08.651896+0000","last_unstale":"2024-05-14T15:17:10.101453+0000","last_undegraded":"2024-05-14T15:17:10.101453+0000","last_fullsized":"2024-05-14T15:17:10.101453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:15.283642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.642888+0000","last_change":"2024-05-14T15:17:07.620613+0000","last_active":"2024-05-14T15:17:09.642888+0000","last_peered":"2024-05-14T15:17:09.642888+0000","last_clean":"2024-05-14T15:17:09.642888+0000","last_became_active":"2024-05-14T15:17:07.619968+0000","last_became_peered":"2024-05-14T15:17:07.619968+0000","last_unstale":"2024-05-14T15:17:09.642888+0000","last_undegraded":"2024-05-14T15:17:09.642888+0000","last_fullsized":"2024-05-14T15:17:09.642888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:23.622896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101818+0000","last_change":"2024-05-14T15:17:08.649599+0000","last_active":"2024-05-14T15:17:10.101818+0000","last_peered":"2024-05-14T15:17:10.101818+0000","last_clean":"2024-05-14T15:17:10.101818+0000","last_became_active":"2024-05-14T15:17:08.649266+0000","last_became_peered":"2024-05-14T15:17:08.649266+0000","last_unstale":"2024-05-14T15:17:10.101818+0000","last_undegraded":"2024-05-14T15:17:10.101818+0000","last_fullsized":"2024-05-14T15:17:10.101818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:31:21.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105301+0000","last_change":"2024-05-14T15:17:07.619008+0000","last_active":"2024-05-14T15:17:10.105301+0000","last_peered":"2024-05-14T15:17:10.105301+0000","last_clean":"2024-05-14T15:17:10.105301+0000","last_became_active":"2024-05-14T15:17:07.618709+0000","last_became_peered":"2024-05-14T15:17:07.618709+0000","last_unstale":"2024-05-14T15:17:10.105301+0000","last_undegraded":"2024-05-14T15:17:10.105301+0000","last_fullsized":"2024-05-14T15:17:10.105301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:11:14.267105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.638062+0000","last_change":"2024-05-14T15:17:08.655258+0000","last_active":"2024-05-14T15:17:09.638062+0000","last_peered":"2024-05-14T15:17:09.638062+0000","last_clean":"2024-05-14T15:17:09.638062+0000","last_became_active":"2024-05-14T15:17:08.654922+0000","last_became_peered":"2024-05-14T15:17:08.654922+0000","last_unstale":"2024-05-14T15:17:09.638062+0000","last_undegraded":"2024-05-14T15:17:09.638062+0000","last_fullsized":"2024-05-14T15:17:09.638062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:08:21.339685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.637385+0000","last_change":"2024-05-14T15:17:07.614107+0000","last_active":"2024-05-14T15:17:09.637385+0000","last_peered":"2024-05-14T15:17:09.637385+0000","last_clean":"2024-05-14T15:17:09.637385+0000","last_became_active":"2024-05-14T15:17:07.613803+0000","last_became_peered":"2024-05-14T15:17:07.613803+0000","last_unstale":"2024-05-14T15:17:09.637385+0000","last_undegraded":"2024-05-14T15:17:09.637385+0000","last_fullsized":"2024-05-14T15:17:09.637385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:21.125875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105898+0000","last_change":"2024-05-14T15:17:08.641458+0000","last_active":"2024-05-14T15:17:10.105898+0000","last_peered":"2024-05-14T15:17:10.105898+0000","last_clean":"2024-05-14T15:17:10.105898+0000","last_became_active":"2024-05-14T15:17:08.638469+0000","last_became_peered":"2024-05-14T15:17:08.638469+0000","last_unstale":"2024-05-14T15:17:10.105898+0000","last_undegraded":"2024-05-14T15:17:10.105898+0000","last_fullsized":"2024-05-14T15:17:10.105898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:12:08.191422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.642346+0000","last_change":"2024-05-14T15:17:07.602639+0000","last_active":"2024-05-14T15:17:09.642346+0000","last_peered":"2024-05-14T15:17:09.642346+0000","last_clean":"2024-05-14T15:17:09.642346+0000","last_became_active":"2024-05-14T15:17:07.602178+0000","last_became_peered":"2024-05-14T15:17:07.602178+0000","last_unstale":"2024-05-14T15:17:09.642346+0000","last_undegraded":"2024-05-14T15:17:09.642346+0000","last_fullsized":"2024-05-14T15:17:09.642346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:48.942945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:09.639268+0000","last_change":"2024-05-14T15:17:08.645773+0000","last_active":"2024-05-14T15:17:09.639268+0000","last_peered":"2024-05-14T15:17:09.639268+0000","last_clean":"2024-05-14T15:17:09.639268+0000","last_became_active":"2024-05-14T15:17:08.645410+0000","last_became_peered":"2024-05-14T15:17:08.645410+0000","last_unstale":"2024-05-14T15:17:09.639268+0000","last_undegraded":"2024-05-14T15:17:09.639268+0000","last_fullsized":"2024-05-14T15:17:09.639268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:07.570869+0000","last_clean_scrub_stamp":"2024-05-14T15:17:07.570869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:12:55.781604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.105644+0000","last_change":"2024-05-14T15:17:07.620669+0000","last_active":"2024-05-14T15:17:10.105644+0000","last_peered":"2024-05-14T15:17:10.105644+0000","last_clean":"2024-05-14T15:17:10.105644+0000","last_became_active":"2024-05-14T15:17:07.620170+0000","last_became_peered":"2024-05-14T15:17:07.620170+0000","last_unstale":"2024-05-14T15:17:10.105644+0000","last_undegraded":"2024-05-14T15:17:10.105644+0000","last_fullsized":"2024-05-14T15:17:10.105644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:17:06.554331+0000","last_clean_scrub_stamp":"2024-05-14T15:17:06.554331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:22:28.572775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-14T15:17:10.101488+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:17:10.101488+0000","last_peered":"2024-05-14T15:17:10.101488+0000","last_clean":"2024-05-14T15:17:10.101488+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:17:10.101488+0000","last_undegraded":"2024-05-14T15:17:10.101488+0000","last_fullsized":"2024-05-14T15:17:10.101488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":194572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":194536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":785452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":194592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":196696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":784892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":194594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":475136,"data_stored":196238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:17:14.007 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T15:17:14.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-14T15:17:14.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.346+0000 7fc8afe00640 1 Processor -- start 2024-05-14T15:17:14.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.346+0000 7fc8afe00640 1 -- start start 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8afe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8b0160210 0x7fc8b00d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8afe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b006c820 con 0x7fc8b00d0910 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8afe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b006cb00 con 0x7fc8b00d4f10 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8afe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b00b4ed0 con 0x7fc8b0160210 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8aea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8b0160210 0x7fc8b00d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8af400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8b00d0910 0x7fc8b00d0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41616/0 (socket says 172.21.15.2:41616) 2024-05-14T15:17:14.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.348+0000 7fc8af400640 1 -- 172.21.15.2:0/482834972 learned_addr learned my addr 172.21.15.2:0/482834972 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.349+0000 7fc8aea00640 1 -- 172.21.15.2:0/482834972 >> v1:172.21.15.156:6789/0 conn(0x7fc8b00d4f10 legacy=0x7fc8b00b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.349+0000 7fc8aea00640 1 -- 172.21.15.2:0/482834972 >> v1:172.21.15.2:6789/0 conn(0x7fc8b00d0910 legacy=0x7fc8b00d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.349+0000 7fc8aea00640 1 -- 172.21.15.2:0/482834972 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b006cde0 con 0x7fc8b0160210 2024-05-14T15:17:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.349+0000 7fc8ad600640 1 -- 172.21.15.2:0/482834972 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508912859 0 0) 0x7fc8b006c820 con 0x7fc8b00d0910 2024-05-14T15:17:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.350+0000 7fc8aea00640 1 --2- 172.21.15.2:0/482834972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b0160210 0x7fc8b00d3ca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00097a0 tx=0x7fc8a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b9f426e5b34ed8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.351+0000 7fc8ad600640 1 -- 172.21.15.2:0/482834972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0037070 con 0x7fc8b0160210 2024-05-14T15:17:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.351+0000 7fc8ad600640 1 -- 172.21.15.2:0/482834972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a002ae50 con 0x7fc8b0160210 2024-05-14T15:17:14.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.351+0000 7fc8ad600640 1 -- 172.21.15.2:0/482834972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0032660 con 0x7fc8b0160210 2024-05-14T15:17:14.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.351+0000 7fc8afe00640 1 -- 172.21.15.2:0/482834972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b0160210 msgr2=0x7fc8b00d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.351+0000 7fc8afe00640 1 --2- 172.21.15.2:0/482834972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b0160210 0x7fc8b00d3ca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00097a0 tx=0x7fc8a002a100 comp rx=0 tx=0).stop 2024-05-14T15:17:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.351+0000 7fc8afe00640 1 -- 172.21.15.2:0/482834972 shutdown_connections 2024-05-14T15:17:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.352+0000 7fc8afe00640 1 --2- 172.21.15.2:0/482834972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b0160210 0x7fc8b00d3ca0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.352+0000 7fc8afe00640 1 -- 172.21.15.2:0/482834972 >> 172.21.15.2:0/482834972 conn(0x7fc8b00d6050 msgr2=0x7fc8b00d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.352+0000 7fc8afe00640 1 -- 172.21.15.2:0/482834972 shutdown_connections 2024-05-14T15:17:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.352+0000 7fc8afe00640 1 -- 172.21.15.2:0/482834972 wait complete. 2024-05-14T15:17:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.354+0000 7fc8afe00640 1 Processor -- start 2024-05-14T15:17:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.354+0000 7fc8afe00640 1 -- start start 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8afe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00d0910 0x7fc8b00ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8afe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 0x7fc8b0151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8afe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0160210 0x7fc8b00ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8afe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b00b9700 con 0x7fc8b00d4f10 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8afe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b00d54d0 con 0x7fc8b00d0910 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8afe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b006d5e0 con 0x7fc8b0160210 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8ae000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 0x7fc8b0151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8ae000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 0x7fc8b0151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58824/0 (socket says 172.21.15.2:58824) 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8ae000640 1 -- 172.21.15.2:0/14206335 learned_addr learned my addr 172.21.15.2:0/14206335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8aea00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00d0910 0x7fc8b00ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.356+0000 7fc8af400640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0160210 0x7fc8b00ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8ae000640 1 -- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0160210 msgr2=0x7fc8b00ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8ae000640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0160210 0x7fc8b00ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8ae000640 1 -- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00d0910 msgr2=0x7fc8b00ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8ae000640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00d0910 0x7fc8b00ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8ae000640 1 -- 172.21.15.2:0/14206335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b00acde0 con 0x7fc8b00d4f10 2024-05-14T15:17:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8ae000640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 0x7fc8b0151690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc89800b3f0 tx=0x7fc89800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898015020 con 0x7fc8b00d4f10 2024-05-14T15:17:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc898011830 con 0x7fc8b00d4f10 2024-05-14T15:17:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.357+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898011c20 con 0x7fc8b00d4f10 2024-05-14T15:17:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.358+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b00ad0c0 con 0x7fc8b00d4f10 2024-05-14T15:17:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.358+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b00ad680 con 0x7fc8b00d4f10 2024-05-14T15:17:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.359+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b0050870 con 0x7fc8b00d4f10 2024-05-14T15:17:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.360+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc898018020 con 0x7fc8b00d4f10 2024-05-14T15:17:14.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.361+0000 7fc8a6a00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc88c076300 0x7fc88c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.361+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc898097420 con 0x7fc8b00d4f10 2024-05-14T15:17:14.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.362+0000 7fc8aea00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc88c076300 0x7fc88c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.363+0000 7fc8aea00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc88c076300 0x7fc88c078810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:14.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.366+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc89801f030 con 0x7fc8b00d4f10 2024-05-14T15:17:14.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.658+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc8b006dc80 con 0x7fc8b00d4f10 2024-05-14T15:17:14.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.665+0000 7fc8a6a00640 1 -- 172.21.15.2:0/14206335 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fc898060b60 con 0x7fc8b00d4f10 2024-05-14T15:17:14.664 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-05-14T15:17:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDlf0NmBstLGRAAlDPeAYruInsfHUZyxMEQcw== 2024-05-14T15:17:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2024-05-14T15:17:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2024-05-14T15:17:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-14T15:17:14.664 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc88c076300 msgr2=0x7fc88c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc88c076300 0x7fc88c078810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a002e000 comp rx=0 tx=0).stop 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 msgr2=0x7fc8b0151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 0x7fc8b0151690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc89800b3f0 tx=0x7fc89800b8b0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 shutdown_connections 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc88c076300 0x7fc88c078810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0160210 0x7fc8b00ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8b00d4f10 0x7fc8b0151690 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 --2- 172.21.15.2:0/14206335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00d0910 0x7fc8b00ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 >> 172.21.15.2:0/14206335 conn(0x7fc8b00d6050 msgr2=0x7fc8b0068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 shutdown_connections 2024-05-14T15:17:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.668+0000 7fc8afe00640 1 -- 172.21.15.2:0/14206335 wait complete. 2024-05-14T15:17:14.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:17:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.985+0000 7fa47fe00640 1 Processor -- start 2024-05-14T15:17:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.985+0000 7fa47fe00640 1 -- start start 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa48006e660 0x7fa4800b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4800b2040 0x7fa4800b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47fe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800b2da0 con 0x7fa4800b2990 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa4800b0d40 con 0x7fa4800b2040 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa4800b1020 con 0x7fa48006e660 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4800b2040 0x7fa4800b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4800b2040 0x7fa4800b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58830/0 (socket says 172.21.15.2:58830) 2024-05-14T15:17:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47e000640 1 -- 172.21.15.2:0/4077255621 learned_addr learned my addr 172.21.15.2:0/4077255621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.988+0000 7fa47ea00640 1 --2- 172.21.15.2:0/4077255621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa48006e660 0x7fa4800b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.989+0000 7fa47e000640 1 -- 172.21.15.2:0/4077255621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa48006e660 msgr2=0x7fa4800b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.989+0000 7fa47e000640 1 --2- 172.21.15.2:0/4077255621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa48006e660 0x7fa4800b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.989+0000 7fa47e000640 1 -- 172.21.15.2:0/4077255621 >> v1:172.21.15.156:6789/0 conn(0x7fa4800b2990 legacy=0x7fa48006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.989+0000 7fa47e000640 1 -- 172.21.15.2:0/4077255621 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4800b1300 con 0x7fa4800b2040 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.990+0000 7fa47e000640 1 --2- 172.21.15.2:0/4077255621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4800b2040 0x7fa4800b2450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa468009870 tx=0x7fa46802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b3068e4a1d9c5d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.990+0000 7fa47d600640 1 -- 172.21.15.2:0/4077255621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468037070 con 0x7fa4800b2040 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.990+0000 7fa47d600640 1 -- 172.21.15.2:0/4077255621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46802adf0 con 0x7fa4800b2040 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.990+0000 7fa47d600640 1 -- 172.21.15.2:0/4077255621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468032660 con 0x7fa4800b2040 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 -- 172.21.15.2:0/4077255621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4800b2040 msgr2=0x7fa4800b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 --2- 172.21.15.2:0/4077255621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4800b2040 0x7fa4800b2450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa468009870 tx=0x7fa46802a0a0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 -- 172.21.15.2:0/4077255621 shutdown_connections 2024-05-14T15:17:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 --2- 172.21.15.2:0/4077255621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4800b2040 0x7fa4800b2450 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 --2- 172.21.15.2:0/4077255621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa48006e660 0x7fa4800b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 -- 172.21.15.2:0/4077255621 >> 172.21.15.2:0/4077255621 conn(0x7fa480073dc0 msgr2=0x7fa48009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 -- 172.21.15.2:0/4077255621 shutdown_connections 2024-05-14T15:17:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.991+0000 7fa47fe00640 1 -- 172.21.15.2:0/4077255621 wait complete. 2024-05-14T15:17:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.994+0000 7fa47fe00640 1 Processor -- start 2024-05-14T15:17:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.994+0000 7fa47fe00640 1 -- start start 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 0x7fa4801498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4800b2040 0x7fa4801e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4800b2990 0x7fa4801547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4800d2140 con 0x7fa48006e660 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa4800d1fc0 con 0x7fa4800b2040 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47fe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa4800d22c0 con 0x7fa4800b2990 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.995+0000 7fa47ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 0x7fa4801498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 0x7fa4801498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58844/0 (socket says 172.21.15.2:58844) 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 -- 172.21.15.2:0/1858768955 learned_addr learned my addr 172.21.15.2:0/1858768955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47e000640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4800b2040 0x7fa4801e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47f400640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4800b2990 0x7fa4801547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 -- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4800b2990 msgr2=0x7fa4801547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4800b2990 0x7fa4801547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 -- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4800b2040 msgr2=0x7fa4801e7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4800b2040 0x7fa4801e7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 -- 172.21.15.2:0/1858768955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4801e5b00 con 0x7fa48006e660 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47e000640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4800b2040 0x7fa4801e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:14.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47f400640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4800b2990 0x7fa4801547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:14.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.996+0000 7fa47ea00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 0x7fa4801498b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa470007e70 tx=0x7fa47000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:14.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.997+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470014620 con 0x7fa48006e660 2024-05-14T15:17:14.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.997+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa470019070 con 0x7fa48006e660 2024-05-14T15:17:14.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.997+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470014a00 con 0x7fa48006e660 2024-05-14T15:17:14.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.997+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4801e5de0 con 0x7fa48006e660 2024-05-14T15:17:14.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.997+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4801e63a0 con 0x7fa48006e660 2024-05-14T15:17:14.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:14.998+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa480050870 con 0x7fa48006e660 2024-05-14T15:17:14.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.000+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa470014ba0 con 0x7fa48006e660 2024-05-14T15:17:14.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.000+0000 7fa476a00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa45c0762d0 0x7fa45c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:14.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.001+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa470098060 con 0x7fa48006e660 2024-05-14T15:17:15.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.001+0000 7fa47e000640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa45c0762d0 0x7fa45c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.002+0000 7fa47e000640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa45c0762d0 0x7fa45c0787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa468034000 tx=0x7fa46802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.005+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa470061790 con 0x7fa48006e660 2024-05-14T15:17:15.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.252+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4800b1b00 con 0x7fa48006e660 2024-05-14T15:17:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.254+0000 7fa476a00640 1 -- 172.21.15.2:0/1858768955 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7fa470061090 con 0x7fa48006e660 2024-05-14T15:17:15.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:15.253 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:17:08.156565+0000","modified":"2024-05-14T15:17:11.317343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.2:6835/3645921439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3645921439},{"type":"v1","addr":"172.21.15.2:6835","nonce":3645921439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4947,"qdb_cluster":[4947]},"id":2}]} 2024-05-14T15:17:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-05-14T15:17:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa45c0762d0 msgr2=0x7fa45c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa45c0762d0 0x7fa45c0787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa468034000 tx=0x7fa46802e000 comp rx=0 tx=0).stop 2024-05-14T15:17:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 msgr2=0x7fa4801498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 0x7fa4801498b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa470007e70 tx=0x7fa47000e4b0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 shutdown_connections 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa45c0762d0 0x7fa45c0787e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4800b2040 0x7fa4801e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4800b2990 0x7fa4801547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 --2- 172.21.15.2:0/1858768955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48006e660 0x7fa4801498b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.256+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 >> 172.21.15.2:0/1858768955 conn(0x7fa480073dc0 msgr2=0x7fa480156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.257+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 shutdown_connections 2024-05-14T15:17:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.257+0000 7fa47fe00640 1 -- 172.21.15.2:0/1858768955 wait complete. 2024-05-14T15:17:15.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T15:17:08.156565+0000', 'modified': '2024-05-14T15:17:11.317343+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4947}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4947': {'gid': 4947, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.2:6835/3645921439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3645921439}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3645921439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4947, 'qdb_cluster': [4947]} 2024-05-14T15:17:15.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T15:17:15.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-14T15:17:15.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.976+0000 7f1d53e00640 1 Processor -- start 2024-05-14T15:17:15.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.977+0000 7f1d53e00640 1 -- start start 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d53e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d540af630 0x7f1d54161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d53e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d540d0740 0x7f1d5415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d53e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d54162150 con 0x7f1d54161d40 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d53e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1d540b0f70 con 0x7f1d540af630 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d53e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f1d540b0360 con 0x7f1d540d0740 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d52a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d540af630 0x7f1d54161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d52a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d540af630 0x7f1d54161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58846/0 (socket says 172.21.15.2:58846) 2024-05-14T15:17:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.979+0000 7f1d52a00640 1 -- 172.21.15.2:0/2296753361 learned_addr learned my addr 172.21.15.2:0/2296753361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:15.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.980+0000 7f1d52a00640 1 -- 172.21.15.2:0/2296753361 >> v2:172.21.15.156:3300/0 conn(0x7f1d540d0740 msgr2=0x7f1d5415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:15.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.980+0000 7f1d53400640 1 --2- 172.21.15.2:0/2296753361 >> v2:172.21.15.156:3300/0 conn(0x7f1d540d0740 0x7f1d5415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.980+0000 7f1d52a00640 1 --2- 172.21.15.2:0/2296753361 >> v2:172.21.15.156:3300/0 conn(0x7f1d540d0740 0x7f1d5415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.980+0000 7f1d52a00640 1 -- 172.21.15.2:0/2296753361 >> v1:172.21.15.156:6789/0 conn(0x7f1d54161d40 legacy=0x7f1d5415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:15.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.980+0000 7f1d52a00640 1 -- 172.21.15.2:0/2296753361 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d540b0640 con 0x7f1d540af630 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.981+0000 7f1d52a00640 1 --2- 172.21.15.2:0/2296753361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540af630 0x7f1d54161800 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d540b69f0 tx=0x7f1d4402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb74001d2bc5558 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.981+0000 7f1d52000640 1 -- 172.21.15.2:0/2296753361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44037070 con 0x7f1d540af630 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.981+0000 7f1d52000640 1 -- 172.21.15.2:0/2296753361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44032440 con 0x7f1d540af630 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.981+0000 7f1d52000640 1 -- 172.21.15.2:0/2296753361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44032810 con 0x7f1d540af630 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 -- 172.21.15.2:0/2296753361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540af630 msgr2=0x7f1d54161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 --2- 172.21.15.2:0/2296753361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540af630 0x7f1d54161800 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d540b69f0 tx=0x7f1d4402a140 comp rx=0 tx=0).stop 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 -- 172.21.15.2:0/2296753361 shutdown_connections 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 --2- 172.21.15.2:0/2296753361 >> v2:172.21.15.156:3300/0 conn(0x7f1d540d0740 0x7f1d5415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 --2- 172.21.15.2:0/2296753361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540af630 0x7f1d54161800 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 -- 172.21.15.2:0/2296753361 >> 172.21.15.2:0/2296753361 conn(0x7f1d540739a0 msgr2=0x7f1d54073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 -- 172.21.15.2:0/2296753361 shutdown_connections 2024-05-14T15:17:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.982+0000 7f1d53e00640 1 -- 172.21.15.2:0/2296753361 wait complete. 2024-05-14T15:17:15.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.984+0000 7f1d53e00640 1 Processor -- start 2024-05-14T15:17:15.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.985+0000 7f1d53e00640 1 -- start start 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d53e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d540af630 0x7f1d54152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d53e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 0x7f1d541e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d53e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d54161d40 0x7f1d540b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d53e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d54162560 con 0x7f1d540d0740 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d53e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1d540b0c00 con 0x7f1d54161d40 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d53e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1d540afa40 con 0x7f1d540af630 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 0x7f1d541e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 0x7f1d541e95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58862/0 (socket says 172.21.15.2:58862) 2024-05-14T15:17:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.986+0000 7f1d4be00640 1 -- 172.21.15.2:0/1685511053 learned_addr learned my addr 172.21.15.2:0/1685511053 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d52a00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d540af630 0x7f1d54152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4be00640 1 -- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d540af630 msgr2=0x7f1d54152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d53400640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d54161d40 0x7f1d540b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4be00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d540af630 0x7f1d54152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4be00640 1 -- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d54161d40 msgr2=0x7f1d540b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4be00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d54161d40 0x7f1d540b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4be00640 1 -- 172.21.15.2:0/1685511053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d541ea950 con 0x7f1d540d0740 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4be00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 0x7f1d541e95f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00b3c0 tx=0x7f1d3c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4b400640 1 -- 172.21.15.2:0/1685511053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c015020 con 0x7f1d540d0740 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4b400640 1 -- 172.21.15.2:0/1685511053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c011830 con 0x7f1d540d0740 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.987+0000 7f1d4b400640 1 -- 172.21.15.2:0/1685511053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011c40 con 0x7f1d540d0740 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.988+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d541ea0b0 con 0x7f1d540d0740 2024-05-14T15:17:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.988+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d541ea670 con 0x7f1d540d0740 2024-05-14T15:17:15.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.990+0000 7f1d4b400640 1 -- 172.21.15.2:0/1685511053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d3c018020 con 0x7f1d540d0740 2024-05-14T15:17:15.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.991+0000 7f1d4b400640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1d30076320 0x7f1d30078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.991+0000 7f1d4b400640 1 -- 172.21.15.2:0/1685511053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1d3c097740 con 0x7f1d540d0740 2024-05-14T15:17:15.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.992+0000 7f1d60d65740 1 Processor -- start 2024-05-14T15:17:15.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.992+0000 7f1d52a00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1d30076320 0x7f1d30078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.992+0000 7f1d60d65740 1 -- start start 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d52a00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1d30076320 0x7f1d30078830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d44034000 tx=0x7f1d4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d9994610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95ce3b0 0x5584d9998050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d60d65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5584d98fd790 con 0x5584d95f7270 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5584d98a2f20 con 0x5584d95d6590 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.993+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x5584d98f9750 con 0x5584d95ce3b0 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d9994610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d9994610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58864/0 (socket says 172.21.15.2:58864) 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 -- 172.21.15.2:0/3969879803 learned_addr learned my addr 172.21.15.2:0/3969879803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d4be00640 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95ce3b0 0x5584d9998050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 -- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95ce3b0 msgr2=0x5584d9998050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95ce3b0 0x5584d9998050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 -- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 msgr2=0x5584d99c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d53400640 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 -- 172.21.15.2:0/3969879803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584d960f2d0 con 0x5584d95f7270 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d4be00640 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95ce3b0 0x5584d9998050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.994+0000 7f1d52a00640 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d9994610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1d4402a730 tx=0x7f1d4402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2551d4e5aafc4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:15.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.995+0000 7f1d43400640 1 -- 172.21.15.2:0/3969879803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44037040 con 0x5584d95f7270 2024-05-14T15:17:15.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.995+0000 7f1d43400640 1 -- 172.21.15.2:0/3969879803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4404c070 con 0x5584d95f7270 2024-05-14T15:17:15.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.995+0000 7f1d43400640 1 -- 172.21.15.2:0/3969879803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4403c860 con 0x5584d95f7270 2024-05-14T15:17:15.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 -- 172.21.15.2:0/3969879803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 msgr2=0x5584d9994610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d9994610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1d4402a730 tx=0x7f1d4402c000 comp rx=0 tx=0).stop 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 -- 172.21.15.2:0/3969879803 shutdown_connections 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95ce3b0 0x5584d9998050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3969879803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d9994610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 -- 172.21.15.2:0/3969879803 >> 172.21.15.2:0/3969879803 conn(0x5584d95eb3c0 msgr2=0x5584d9999bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 -- 172.21.15.2:0/3969879803 shutdown_connections 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.996+0000 7f1d60d65740 1 -- 172.21.15.2:0/3969879803 wait complete. 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.997+0000 7f1d60d65740 1 -- start start 2024-05-14T15:17:15.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.997+0000 7f1d60d65740 1 Processor -- start 2024-05-14T15:17:15.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d99bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99d5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95f7270 0x5584d99f1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5584d99c1fa0 con 0x5584d95ce3b0 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5584d98b69c0 con 0x5584d95d6590 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x5584d9994b50 con 0x5584d95f7270 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d60d65740 10 client.0 _ll_register_callbacks cb 0x5584d9883120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d99bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d99bfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58876/0 (socket says 172.21.15.2:58876) 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 -- 172.21.15.2:0/2908882714 learned_addr learned my addr 172.21.15.2:0/2908882714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 -- 172.21.15.2:0/2908882714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95f7270 msgr2=0x5584d99f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95f7270 0x5584d99f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 -- 172.21.15.2:0/2908882714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 msgr2=0x5584d99d5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99d5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:15.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:15.999+0000 7f1d52a00640 1 -- 172.21.15.2:0/2908882714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584d96d96b0 con 0x5584d95ce3b0 2024-05-14T15:17:16.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.000+0000 7f1d52a00640 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d99bfe30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5584d99e27f0 tx=0x7f1d44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe99e011562790da server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:16.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.000+0000 7f1d37e00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-05-14T15:17:16.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.000+0000 7f1d37e00640 1 -- 172.21.15.2:0/2908882714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44057070 con 0x5584d95ce3b0 2024-05-14T15:17:16.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.000+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4404c070 con 0x5584d95ce3b0 2024-05-14T15:17:16.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.000+0000 7f1d37e00640 1 -- 172.21.15.2:0/2908882714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1d44003ae0 con 0x5584d95ce3b0 2024-05-14T15:17:16.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d37e00640 1 -- 172.21.15.2:0/2908882714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d44061050 con 0x5584d95ce3b0 2024-05-14T15:17:16.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 10 client.5112 fetch_fsmap learned FSMap version 17 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5584d99d66a0 con 0x5584d95ce3b0 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d37e00640 1 -- 172.21.15.2:0/2908882714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4404c070 con 0x5584d95ce3b0 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d37e00640 1 -- 172.21.15.2:0/2908882714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f1d44064020 con 0x5584d95ce3b0 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 10 client.5112 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 10 client.5112 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 20 client.5112 populate_metadata read hostname 'smithi002' 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d95b5e40 0x5584d99fbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 4 client.5112 mds_command: new command op to 4947 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.001+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 --> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584d990b3a0 con 0x5584d95b5e40 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.002+0000 7f1d4be00640 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d95b5e40 0x5584d99fbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.002+0000 7f1d4be00640 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d95b5e40 0x5584d99fbee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302ae6e8e090af0f server_cookie=54948e7bf7dc0133 in_seq=0 out_seq=0 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.002+0000 7f1d37e00640 10 client.5112 ms_handle_connect on v2:172.21.15.2:6834/3645921439 2024-05-14T15:17:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d37e00640 1 -- 172.21.15.2:0/2908882714 <== mds.0 v2:172.21.15.2:6834/3645921439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5584d990b3a0 con 0x5584d95b5e40 2024-05-14T15:17:16.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d37e00640 10 client.5112 handle_command_reply: tid=0 2024-05-14T15:17:16.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 client.5112 shutdown 2024-05-14T15:17:16.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 msgr2=0x5584d99bfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d99bfe30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5584d99e27f0 tx=0x7f1d44004730 comp rx=0 tx=0).stop 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 shutdown_connections 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d95b5e40 0x5584d99fbee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95d6590 0x5584d99d5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95f7270 0x5584d99f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d37e00640 0 client.5112 ms_handle_reset on v2:172.21.15.2:6834/3645921439 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 --2- 172.21.15.2:0/2908882714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d99bfe30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.003+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 >> 172.21.15.2:0/2908882714 conn(0x5584d95eb3c0 msgr2=0x5584d9999bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.004+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 shutdown_connections 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.004+0000 7f1d60d65740 1 -- 172.21.15.2:0/2908882714 wait complete. 2024-05-14T15:17:16.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.004+0000 7f1d60d65740 20 client.5112 trim_cache size 0 max 16384 2024-05-14T15:17:16.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.024+0000 7f1d60d65740 1 Processor -- start 2024-05-14T15:17:16.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.024+0000 7f1d60d65740 1 -- start start 2024-05-14T15:17:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.025+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95ce3b0 0x5584d99e2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.025+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.025+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d99c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.025+0000 7f1d60d65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d54206430 con 0x5584d95f7270 2024-05-14T15:17:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.025+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541fbe40 con 0x5584d95ce3b0 2024-05-14T15:17:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.025+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f1d541e8210 con 0x5584d95d6590 2024-05-14T15:17:16.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d99c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d99c03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58892/0 (socket says 172.21.15.2:58892) 2024-05-14T15:17:16.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 -- 172.21.15.2:0/3926291709 learned_addr learned my addr 172.21.15.2:0/3926291709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:16.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 -- 172.21.15.2:0/3926291709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 msgr2=0x5584d99e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:16.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 -- 172.21.15.2:0/3926291709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95ce3b0 msgr2=0x5584d99e2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95ce3b0 0x5584d99e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 -- 172.21.15.2:0/3926291709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584d990bad0 con 0x5584d95f7270 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d53400640 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d99c03a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009c30 tx=0x7f1d4c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0b31e48bc5bd89 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.026+0000 7f1d42a00640 1 -- 172.21.15.2:0/3926291709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c019480 con 0x5584d95f7270 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d42a00640 1 -- 172.21.15.2:0/3926291709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c019620 con 0x5584d95f7270 2024-05-14T15:17:16.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d42a00640 1 -- 172.21.15.2:0/3926291709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c019a10 con 0x5584d95f7270 2024-05-14T15:17:16.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 -- 172.21.15.2:0/3926291709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 msgr2=0x5584d99c03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d99c03a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009c30 tx=0x7f1d4c00e720 comp rx=0 tx=0).stop 2024-05-14T15:17:16.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 -- 172.21.15.2:0/3926291709 shutdown_connections 2024-05-14T15:17:16.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95f7270 0x5584d99c03a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 --2- 172.21.15.2:0/3926291709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95ce3b0 0x5584d99e2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 -- 172.21.15.2:0/3926291709 >> 172.21.15.2:0/3926291709 conn(0x5584d95eb3c0 msgr2=0x5584d99f0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:16.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.027+0000 7f1d60d65740 1 -- 172.21.15.2:0/3926291709 shutdown_connections 2024-05-14T15:17:16.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.028+0000 7f1d60d65740 1 -- 172.21.15.2:0/3926291709 wait complete. 2024-05-14T15:17:16.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.029+0000 7f1d60d65740 1 -- start start 2024-05-14T15:17:16.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.029+0000 7f1d60d65740 1 Processor -- start 2024-05-14T15:17:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.030+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d9994f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.030+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.030+0000 7f1d60d65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95f7270 0x5584d99e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.030+0000 7f1d60d65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5584d99ef7a0 con 0x5584d95ce3b0 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.030+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5584d99c1fa0 con 0x5584d95f7270 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.030+0000 7f1d60d65740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x5584d99dc270 con 0x5584d95d6590 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d60d65740 10 client.0 _ll_register_callbacks cb 0x7f1d440096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d9994f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d9994f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58898/0 (socket says 172.21.15.2:58898) 2024-05-14T15:17:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 -- 172.21.15.2:0/1596372302 learned_addr learned my addr 172.21.15.2:0/1596372302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d4be00640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 -- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 msgr2=0x5584d99e2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 -- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95f7270 msgr2=0x5584d99e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d53400640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95f7270 0x5584d99e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95f7270 0x5584d99e2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.031+0000 7f1d52a00640 1 -- 172.21.15.2:0/1596372302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584d9a5d310 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d52a00640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d9994f10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1d4402a6b0 tx=0x7f1d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d53f35c8fce66a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d37e00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d37e00640 1 -- 172.21.15.2:0/1596372302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44057040 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d37e00640 1 -- 172.21.15.2:0/1596372302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1d44051d30 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4c019620 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d37e00640 1 -- 172.21.15.2:0/1596372302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d4406a050 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d60d65740 10 client.5118 fetch_fsmap learned FSMap version 17 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5584d99dab00 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.032+0000 7f1d37e00640 1 -- 172.21.15.2:0/1596372302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c019620 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d37e00640 1 -- 172.21.15.2:0/1596372302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f1d4406d020 con 0x5584d95ce3b0 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d60d65740 10 client.5118 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T15:17:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d60d65740 10 client.5118 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d60d65740 20 client.5118 populate_metadata read hostname 'smithi002' 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d60d65740 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d99be5d0 0x5584d99be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d60d65740 4 client.5118 mds_command: new command op to 4947 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 --> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] -- command(tid 0: {"prefix": "status"}) -- 0x5584d9905210 con 0x5584d99be5d0 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d4be00640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d99be5d0 0x5584d99be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d4be00640 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d99be5d0 0x5584d99be9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154e08fa97271f6a server_cookie=5da43a449b4b8d99 in_seq=0 out_seq=0 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.033+0000 7f1d37e00640 10 client.5118 ms_handle_connect on v2:172.21.15.2:6834/3645921439 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d37e00640 1 -- 172.21.15.2:0/1596372302 <== mds.0 v2:172.21.15.2:6834/3645921439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5584d9905210 con 0x5584d99be5d0 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d37e00640 10 client.5118 handle_command_reply: tid=0 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 client.5118 shutdown 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 msgr2=0x5584d9994f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d9994f10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1d4402a6b0 tx=0x7f1d440046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 shutdown_connections 2024-05-14T15:17:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:6834/3645921439,v1:172.21.15.2:6835/3645921439] conn(0x5584d99be5d0 0x5584d99be9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584d95f7270 0x5584d99e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584d95d6590 0x5584d99e2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 --2- 172.21.15.2:0/1596372302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584d95ce3b0 0x5584d9994f10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d37e00640 0 client.5118 ms_handle_reset on v2:172.21.15.2:6834/3645921439 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 >> 172.21.15.2:0/1596372302 conn(0x5584d95eb3c0 msgr2=0x5584d99f0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 shutdown_connections 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 1 -- 172.21.15.2:0/1596372302 wait complete. 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.034+0000 7f1d60d65740 20 client.5118 trim_cache size 0 max 16384 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "c9147305-965e-4a8b-a03b-3f802813a40c", 2024-05-14T15:17:16.036 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4947, 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 7.4315836920000002, 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 17, 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 40, 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 40, 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 16.506453959000002 2024-05-14T15:17:16.037 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1d30076320 msgr2=0x7f1d30078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1d30076320 0x7f1d30078830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d44034000 tx=0x7f1d4402e000 comp rx=0 tx=0).stop 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 msgr2=0x7f1d541e95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 0x7f1d541e95f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00b3c0 tx=0x7f1d3c00b880 comp rx=0 tx=0).stop 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 shutdown_connections 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f1d30076320 0x7f1d30078830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d54161d40 0x7f1d540b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d540d0740 0x7f1d541e95f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 --2- 172.21.15.2:0/1685511053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d540af630 0x7f1d54152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 >> 172.21.15.2:0/1685511053 conn(0x7f1d540739a0 msgr2=0x7f1d540b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 shutdown_connections 2024-05-14T15:17:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.035+0000 7f1d53e00640 1 -- 172.21.15.2:0/1685511053 wait complete. 2024-05-14T15:17:16.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T15:17:16.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.347+0000 7ffa1be00640 1 Processor -- start 2024-05-14T15:17:16.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.347+0000 7ffa1be00640 1 -- start start 2024-05-14T15:17:16.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffa1c0b56a0 0x7ffa1c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c0b5ab0 con 0x7ffa1c06d700 2024-05-14T15:17:16.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1be00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c0b0d10 con 0x7ffa1c15ca80 2024-05-14T15:17:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c0b0ff0 con 0x7ffa1c0b56a0 2024-05-14T15:17:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffa1c0b56a0 0x7ffa1c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa1c06d700 0x7ffa1c06db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41618/0 (socket says 172.21.15.2:41618) 2024-05-14T15:17:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.350+0000 7ffa1b400640 1 -- 172.21.15.2:0/2267668525 learned_addr learned my addr 172.21.15.2:0/2267668525 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:17:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.351+0000 7ffa1aa00640 1 -- 172.21.15.2:0/2267668525 >> v1:172.21.15.156:6789/0 conn(0x7ffa1c15ca80 legacy=0x7ffa1c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:17:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.351+0000 7ffa1aa00640 1 -- 172.21.15.2:0/2267668525 >> v1:172.21.15.2:6789/0 conn(0x7ffa1c06d700 legacy=0x7ffa1c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.351+0000 7ffa19600640 1 -- 172.21.15.2:0/2267668525 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692135190 0 0) 0x7ffa14001490 con 0x7ffa1c06d700 2024-05-14T15:17:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.351+0000 7ffa1aa00640 1 -- 172.21.15.2:0/2267668525 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c0b4bc0 con 0x7ffa1c0b56a0 2024-05-14T15:17:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.352+0000 7ffa1aa00640 1 --2- 172.21.15.2:0/2267668525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c0b56a0 0x7ffa1c0b64e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00ba40 tx=0x7ffa0c02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8319ab99883d78e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.352+0000 7ffa19600640 1 -- 172.21.15.2:0/2267668525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c032750 con 0x7ffa1c0b56a0 2024-05-14T15:17:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.352+0000 7ffa19600640 1 -- 172.21.15.2:0/2267668525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c030050 con 0x7ffa1c0b56a0 2024-05-14T15:17:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.352+0000 7ffa19600640 1 -- 172.21.15.2:0/2267668525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c032b10 con 0x7ffa1c0b56a0 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 -- 172.21.15.2:0/2267668525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c0b56a0 msgr2=0x7ffa1c0b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 --2- 172.21.15.2:0/2267668525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c0b56a0 0x7ffa1c0b64e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00ba40 tx=0x7ffa0c02c850 comp rx=0 tx=0).stop 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 -- 172.21.15.2:0/2267668525 shutdown_connections 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 --2- 172.21.15.2:0/2267668525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c0b56a0 0x7ffa1c0b64e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 -- 172.21.15.2:0/2267668525 >> 172.21.15.2:0/2267668525 conn(0x7ffa1c0732e0 msgr2=0x7ffa1c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 -- 172.21.15.2:0/2267668525 shutdown_connections 2024-05-14T15:17:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.353+0000 7ffa1be00640 1 -- 172.21.15.2:0/2267668525 wait complete. 2024-05-14T15:17:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.355+0000 7ffa1be00640 1 Processor -- start 2024-05-14T15:17:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.356+0000 7ffa1be00640 1 -- start start 2024-05-14T15:17:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 0x7ffa1c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0b56a0 0x7ffa1c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15ca80 0x7ffa1c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c15ce90 con 0x7ffa1c06d700 2024-05-14T15:17:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0b5180 con 0x7ffa1c15ca80 2024-05-14T15:17:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c1606c0 con 0x7ffa1c0b56a0 2024-05-14T15:17:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.357+0000 7ffa1aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 0x7ffa1c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 0x7ffa1c156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58922/0 (socket says 172.21.15.2:58922) 2024-05-14T15:17:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 -- 172.21.15.2:0/1950146095 learned_addr learned my addr 172.21.15.2:0/1950146095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1a000640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0b56a0 0x7ffa1c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1b400640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15ca80 0x7ffa1c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 -- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0b56a0 msgr2=0x7ffa1c0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0b56a0 0x7ffa1c0c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 -- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15ca80 msgr2=0x7ffa1c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15ca80 0x7ffa1c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 -- 172.21.15.2:0/1950146095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c1f73f0 con 0x7ffa1c06d700 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1b400640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15ca80 0x7ffa1c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.358+0000 7ffa1aa00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 0x7ffa1c156a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00bb60 tx=0x7ffa0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.359+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c042020 con 0x7ffa1c06d700 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.359+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c034ca0 con 0x7ffa1c06d700 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.359+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c1f76d0 con 0x7ffa1c06d700 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.359+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c03e680 con 0x7ffa1c06d700 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.359+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c159e20 con 0x7ffa1c06d700 2024-05-14T15:17:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.360+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1c068e20 con 0x7ffa1c06d700 2024-05-14T15:17:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.361+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa0c045020 con 0x7ffa1c06d700 2024-05-14T15:17:16.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.362+0000 7ffa12a00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff9fc0762d0 0x7ff9fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:16.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.363+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ffa0c0b8e90 con 0x7ffa1c06d700 2024-05-14T15:17:16.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.363+0000 7ffa1a000640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff9fc0762d0 0x7ff9fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:16.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.364+0000 7ffa1a000640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff9fc0762d0 0x7ff9fc0787e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa08006fd0 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:16.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.366+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa0c04c020 con 0x7ffa1c06d700 2024-05-14T15:17:16.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.621+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffa1c0d0da0 con 0x7ffa1c06d700 2024-05-14T15:17:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.622+0000 7ffa12a00640 1 -- 172.21.15.2:0/1950146095 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7ffa0c0827d0 con 0x7ffa1c06d700 2024-05-14T15:17:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff9fc0762d0 msgr2=0x7ff9fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff9fc0762d0 0x7ff9fc0787e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa08006fd0 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 msgr2=0x7ffa1c156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 0x7ffa1c156a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00bb60 tx=0x7ffa0c0046c0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 shutdown_connections 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff9fc0762d0 0x7ff9fc0787e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15ca80 0x7ffa1c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0b56a0 0x7ffa1c0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 --2- 172.21.15.2:0/1950146095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c06d700 0x7ffa1c156a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.624+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 >> 172.21.15.2:0/1950146095 conn(0x7ffa1c0732e0 msgr2=0x7ffa1c0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.625+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 shutdown_connections 2024-05-14T15:17:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16.625+0000 7ffa1be00640 1 -- 172.21.15.2:0/1950146095 wait complete. 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:17:16.653 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T15:17:16.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:16.654 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.705 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42527sec preferred_lft 42527sec 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 82:3a:42:e2:14:84 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5818:95ff:fe1f:331f/64 scope link 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 82:3a:42:e2:14:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::803a:42ff:fee2:1484/64 scope link 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T15:17:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether e2:c0:67:b6:61:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:16.708 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::e0c0:67ff:feb6:611d/64 scope link 2024-05-14T15:17:16.708 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:17:16.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:16.709 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:17:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-05-14T15:17:16.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:16.793 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-05-14T15:17:16.848 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-05-14T15:17:16.848 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:17:16.848 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T15:17:16.848 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T15:17:16.848 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:17:16.849 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:17:16.849 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-05-14T15:17:16.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T15:17:16.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T15:17:16.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T15:17:16.850 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-05-14T15:17:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:17:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:17.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:17.065 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-05-14T15:17:17.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T15:17:17.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-14T15:17:17.113 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T15:17:17.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:17.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-05-14T15:17:17.201 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-14T15:17:17.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:17:17.202 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:17.260 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T15:17:17.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:17:17.261 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:17.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:17:17.402 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:17:17.463 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:17:17.463 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:17.464 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:17:17.465 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:17:17.466 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:17:17.466 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:17.466 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:17.466 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:17.466 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:17.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:17.467 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:17:17.523 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T15:17:17.523 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-14T15:17:17.530 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:17:17.610 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:17:17.654 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:17:17.654 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:17:17.654 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:17:17.654 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:17:17.655 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:17.656 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:17.657 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:17.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:17.658 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:17:17.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2024-05-14T15:17:17.793+0000 7f2128b09480 -1 init, newargv = 0x555ad7e375f0 newargc=15 2024-05-14T15:17:17.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[47838]: starting ceph client 2024-05-14T15:17:17.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[47838]: starting fuse 2024-05-14T15:17:18.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-05-14T15:17:18.944 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:17:19.006 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-05-14T15:17:19.006 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-05-14T15:17:19.006 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-05-14T15:17:19.007 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T15:17:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-05-14T15:17:19.009 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:19.009 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:17:19.009 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:19.009 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:17:19.009 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:19.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:19.009 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-05-14T15:17:19.063 INFO:teuthology.orchestra.run.smithi002.stdout:40 2024-05-14T15:17:19.063 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-14T15:17:19.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:17:19.063 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-05-14T15:17:19.063 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-05-14T15:17:19.063 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-05-14T15:17:19.063 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-05-14T15:17:19.064 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-05-14T15:17:19.065 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-05-14T15:17:19.065 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:17:19.065 DEBUG:teuthology.orchestra.run.smithi002:> 2024-05-14T15:17:19.065 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2024-05-14T15:17:19.065 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-05-14T15:17:19.238 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.47838.asok 2024-05-14T15:17:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:17:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:19.256 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47838.asok 2024-05-14T15:17:19.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:19.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47838.asok status 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-05-14T15:17:19.563 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "47838", 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5133, 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 5133 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:19.564 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3904448503 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3904448503 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.5133 192.168.0.1:0/3904448503", 2024-05-14T15:17:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/3904448503", 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 17, 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 40, 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-05-14T15:17:19.566 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:17:19.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:19.585 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-05-14T15:17:19.585 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:19.646 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-05-14T15:17:19.646 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:19.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:19.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T15:17:19.740 DEBUG:teuthology.orchestra.run.smithi002:> mktemp -d --suffix=xfstests-dev 2024-05-14T15:17:19.792 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.0ZOtQP6Hmyxfstests-dev 2024-05-14T15:17:19.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:19.792 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.0ZOtQP6Hmyxfstests-dev) 2024-05-14T15:17:19.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:19.881 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.0ZOtQP6Hmyxfstests-dev) 2024-05-14T15:17:19.948 INFO:teuthology.orchestra.run.smithi002.stderr:Cloning into '/tmp/tmp.0ZOtQP6Hmyxfstests-dev'... 2024-05-14T15:17:21.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:21.054 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-14T15:17:21.122 DEBUG:teuthology.orchestra.run.smithi002:> mktemp -d --suffix=test 2024-05-14T15:17:21.175 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.JTI0kNNhc3test 2024-05-14T15:17:21.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:21.176 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-14T15:17:21.232 DEBUG:teuthology.orchestra.run.smithi002:> mktemp -d --suffix=scratch 2024-05-14T15:17:21.286 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.RYHUhQHDMxscratch 2024-05-14T15:17:21.287 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-05-14T15:17:21.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-05-14T15:17:22.159 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:31 ago on Tue 14 May 2024 03:12:51 PM UTC. 2024-05-14T15:17:22.249 INFO:teuthology.orchestra.run.smithi002.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:17:22.249 INFO:teuthology.orchestra.run.smithi002.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T15:17:22.250 INFO:teuthology.orchestra.run.smithi002.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-05-14T15:17:22.251 INFO:teuthology.orchestra.run.smithi002.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-05-14T15:17:22.252 INFO:teuthology.orchestra.run.smithi002.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-05-14T15:17:22.254 INFO:teuthology.orchestra.run.smithi002.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-05-14T15:17:22.255 INFO:teuthology.orchestra.run.smithi002.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-05-14T15:17:22.256 INFO:teuthology.orchestra.run.smithi002.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-05-14T15:17:22.258 INFO:teuthology.orchestra.run.smithi002.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-05-14T15:17:22.260 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:17:22.261 INFO:teuthology.orchestra.run.smithi002.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-05-14T15:17:22.263 INFO:teuthology.orchestra.run.smithi002.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-05-14T15:17:22.263 INFO:teuthology.orchestra.run.smithi002.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T15:17:22.264 INFO:teuthology.orchestra.run.smithi002.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-05-14T15:17:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-05-14T15:17:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-05-14T15:17:22.267 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-05-14T15:17:22.268 INFO:teuthology.orchestra.run.smithi002.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-05-14T15:17:22.269 INFO:teuthology.orchestra.run.smithi002.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-05-14T15:17:22.271 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T15:17:22.320 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-05-14T15:17:22.322 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-05-14T15:17:22.322 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-devel x86_64 5.14.0-446.el9 appstream 16 M 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm-libs x86_64 1:1.23-1.el9 baseos 56 k 2024-05-14T15:17:22.323 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout:Install 17 Packages 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 1 Package 2024-05-14T15:17:22.324 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:17:22.325 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 24 M 2024-05-14T15:17:22.325 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-05-14T15:17:23.044 INFO:teuthology.orchestra.run.smithi002.stdout:(1/18): fio-engine-http-3.35-1.el9.x86_64.rpm 213 kB/s | 18 kB 00:00 2024-05-14T15:17:23.095 INFO:teuthology.orchestra.run.smithi002.stdout:(2/18): fio-engine-libaio-3.35-1.el9.x86_64.rpm 319 kB/s | 16 kB 00:00 2024-05-14T15:17:23.120 INFO:teuthology.orchestra.run.smithi002.stdout:(3/18): rmt-1.6-6.el9.x86_64.rpm 287 kB/s | 46 kB 00:00 2024-05-14T15:17:23.145 INFO:teuthology.orchestra.run.smithi002.stdout:(4/18): fio-engine-nbd-3.35-1.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-05-14T15:17:23.170 INFO:teuthology.orchestra.run.smithi002.stdout:(5/18): fio-engine-rados-3.35-1.el9.x86_64.rpm 320 kB/s | 16 kB 00:00 2024-05-14T15:17:23.196 INFO:teuthology.orchestra.run.smithi002.stdout:(6/18): fio-engine-rbd-3.35-1.el9.x86_64.rpm 329 kB/s | 16 kB 00:00 2024-05-14T15:17:23.254 INFO:teuthology.orchestra.run.smithi002.stdout:(7/18): fio-engine-rdma-3.35-1.el9.x86_64.rpm 249 kB/s | 21 kB 00:00 2024-05-14T15:17:23.321 INFO:teuthology.orchestra.run.smithi002.stdout:(8/18): libcap-devel-2.48-9.el9.x86_64.rpm 618 kB/s | 41 kB 00:00 2024-05-14T15:17:23.480 INFO:teuthology.orchestra.run.smithi002.stdout:(9/18): fio-3.35-1.el9.x86_64.rpm 12 MB/s | 6.2 MB 00:00 2024-05-14T15:17:23.505 INFO:teuthology.orchestra.run.smithi002.stdout:(10/18): libnbd-1.18.1-3.el9.x86_64.rpm 911 kB/s | 166 kB 00:00 2024-05-14T15:17:23.564 INFO:teuthology.orchestra.run.smithi002.stdout:(11/18): sqlite-3.34.1-7.el9.x86_64.rpm 8.9 MB/s | 748 kB 00:00 2024-05-14T15:17:23.598 INFO:teuthology.orchestra.run.smithi002.stdout:(12/18): udftools-2.2-5.el9.x86_64.rpm 1.6 MB/s | 149 kB 00:00 2024-05-14T15:17:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:(13/18): kernel-devel-5.14.0-446.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-05-14T15:17:23.923 INFO:teuthology.orchestra.run.smithi002.stdout:(14/18): gdbm-devel-1.23-1.el9.x86_64.rpm 249 kB/s | 81 kB 00:00 2024-05-14T15:17:23.957 INFO:teuthology.orchestra.run.smithi002.stdout:(15/18): gdbm-1.23-1.el9.x86_64.rpm 390 kB/s | 153 kB 00:00 2024-05-14T15:17:24.093 INFO:teuthology.orchestra.run.smithi002.stdout:(16/18): gdbm-libs-1.23-1.el9.x86_64.rpm 687 kB/s | 56 kB 00:00 2024-05-14T15:17:24.117 INFO:teuthology.orchestra.run.smithi002.stdout:(17/18): dump-0.4-0.51.b47.el9.x86_64.rpm 403 kB/s | 88 kB 00:00 2024-05-14T15:17:24.210 INFO:teuthology.orchestra.run.smithi002.stdout:(18/18): indent-2.2.13-5.el9.x86_64.rpm 630 kB/s | 179 kB 00:00 2024-05-14T15:17:24.214 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:17:24.215 INFO:teuthology.orchestra.run.smithi002.stdout:Total 13 MB/s | 24 MB 00:01 2024-05-14T15:17:25.000 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-05-14T15:17:25.127 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-05-14T15:17:25.127 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-05-14T15:17:25.991 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-05-14T15:17:25.992 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-05-14T15:17:27.302 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-05-14T15:17:27.380 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : gdbm-libs-1:1.23-1.el9.x86_64 1/19 2024-05-14T15:17:27.426 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 2/19 2024-05-14T15:17:27.479 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 3/19 2024-05-14T15:17:27.521 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 4/19 2024-05-14T15:17:27.555 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 5/19 2024-05-14T15:17:27.590 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 6/19 2024-05-14T15:17:27.624 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 7/19 2024-05-14T15:17:27.658 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 8/19 2024-05-14T15:17:27.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 9/19 2024-05-14T15:17:27.979 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-3.35-1.el9.x86_64 10/19 2024-05-14T15:17:28.030 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rmt-2:1.6-6.el9.x86_64 11/19 2024-05-14T15:17:28.083 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 12/19 2024-05-14T15:17:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 13/19 2024-05-14T15:17:28.382 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : indent-2.2.13-5.el9.x86_64 14/19 2024-05-14T15:17:28.456 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : udftools-2.2-5.el9.x86_64 15/19 2024-05-14T15:17:28.551 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 16/19 2024-05-14T15:17:40.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:40.682 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:40.836 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 17/19 2024-05-14T15:17:41.064 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-14T15:18:10.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:10.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:32.941 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-14T15:18:33.097 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-14T15:18:34.003 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-14T15:18:34.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/19 2024-05-14T15:18:34.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-3.35-1.el9.x86_64 2/19 2024-05-14T15:18:34.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/19 2024-05-14T15:18:34.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/19 2024-05-14T15:18:34.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-devel-5.14.0-446.el9.x86_64 9/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 11/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 14/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 15/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/19 2024-05-14T15:18:34.004 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdbm-libs-1:1.23-1.el9.x86_64 18/19 2024-05-14T15:18:34.497 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-14T15:18:34.497 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm-libs-1:1.23-1.el9.x86_64 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-05-14T15:18:34.498 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-05-14T15:18:34.502 INFO:teuthology.orchestra.run.smithi002.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-446.el9.x86_64 2024-05-14T15:18:34.503 INFO:teuthology.orchestra.run.smithi002.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-05-14T15:18:34.503 INFO:teuthology.orchestra.run.smithi002.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-05-14T15:18:34.503 INFO:teuthology.orchestra.run.smithi002.stdout: udftools-2.2-5.el9.x86_64 2024-05-14T15:18:34.503 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:18:34.503 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-05-14T15:18:34.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo useradd -m fsgqa 2024-05-14T15:18:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:useradd: user 'fsgqa' already exists 2024-05-14T15:18:35.029 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-14T15:18:35.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo groupadd fsgqa 2024-05-14T15:18:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:groupadd: group 'fsgqa' already exists 2024-05-14T15:18:35.101 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-14T15:18:35.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo useradd fsgqa2 2024-05-14T15:18:35.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo useradd 123456-fsgqa 2024-05-14T15:18:36.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-14T15:18:36.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.719+0000 7ff6f6000640 1 Processor -- start 2024-05-14T15:18:36.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.719+0000 7ff6f6000640 1 -- start start 2024-05-14T15:18:36.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.721+0000 7ff6f6000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 0x7ff6f006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.721+0000 7ff6f6000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f006e050 con 0x7ff6f00ae750 2024-05-14T15:18:36.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.721+0000 7ff6f6000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f01618d0 con 0x7ff6f00d1050 2024-05-14T15:18:36.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.721+0000 7ff6f6000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f01624e0 con 0x7ff6f006d700 2024-05-14T15:18:36.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.722+0000 7ff6f5600640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff6f00ae750 0x7ff6f00aeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37148/0 (socket says 172.21.15.2:37148) 2024-05-14T15:18:36.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.722+0000 7ff6f5600640 1 -- 172.21.15.2:0/1041304563 learned_addr learned my addr 172.21.15.2:0/1041304563 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:18:36.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.722+0000 7ff6efe00640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 0x7ff6f006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.722+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225432872 0 0) 0x7ff6e8001490 con 0x7ff6f00ae750 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.722+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d8003520 con 0x7ff6f00ae750 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1865518315 0 0) 0x7ff6d8003520 con 0x7ff6f00ae750 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 msgr2=0x7ff6f006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 0x7ff6f006db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 >> v1:172.21.15.156:6789/0 conn(0x7ff6f00d1050 legacy=0x7ff6f0070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f0161bb0 con 0x7ff6f00ae750 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7ff6e8001c40 con 0x7ff6f00ae750 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 >> v1:172.21.15.2:6789/0 conn(0x7ff6f00ae750 legacy=0x7ff6f00aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6d8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 0x7ff6d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6d8004d90 0x7ff6d8005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f01624e0 con 0x7ff6d8003a80 2024-05-14T15:18:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d800bbd0 con 0x7ff6d8004d90 2024-05-14T15:18:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d800bdd0 con 0x7ff6f006d700 2024-05-14T15:18:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.723+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6d8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f5600640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6d8004d90 0x7ff6d8005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6efe00640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 0x7ff6d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 msgr2=0x7ff6d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f006d700 0x7ff6d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6d8004d90 msgr2=0x7ff6d8005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6d8004d90 0x7ff6d8005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1041304563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8003520 con 0x7ff6d8003a80 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.724+0000 7ff6f5600640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6d8004d90 0x7ff6d8005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.725+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6d8003ef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00b3320 tx=0x7ff6d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aae74777c072e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.725+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40013b0 con 0x7ff6d8003a80 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.725+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e40052d0 con 0x7ff6d8003a80 2024-05-14T15:18:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.726+0000 7ff6ef400640 1 -- 172.21.15.2:0/1041304563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e402aa70 con 0x7ff6d8003a80 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.726+0000 7ff6f6000640 1 -- 172.21.15.2:0/1041304563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 msgr2=0x7ff6d8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.726+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1041304563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6d8003ef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00b3320 tx=0x7ff6d8005830 comp rx=0 tx=0).stop 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.726+0000 7ff6f5600640 1 -- 172.21.15.2:0/1041304563 reap_dead start 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.726+0000 7ff6f6000640 1 -- 172.21.15.2:0/1041304563 shutdown_connections 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.726+0000 7ff6f6000640 1 -- 172.21.15.2:0/1041304563 >> 172.21.15.2:0/1041304563 conn(0x7ff6f00732e0 msgr2=0x7ff6f00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.727+0000 7ff6f6000640 1 -- 172.21.15.2:0/1041304563 shutdown_connections 2024-05-14T15:18:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.727+0000 7ff6f6000640 1 -- 172.21.15.2:0/1041304563 wait complete. 2024-05-14T15:18:36.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.729+0000 7ff6f6000640 1 Processor -- start 2024-05-14T15:18:36.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.729+0000 7ff6f6000640 1 -- start start 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6f01e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f6000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f01e80f0 0x7ff6f01f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f6000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6f01ebe40 0x7ff6f01ec250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f6000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0071050 con 0x7ff6d8003a80 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f6000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0162170 con 0x7ff6f01ebe40 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f6000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f015f110 con 0x7ff6f01e80f0 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6f01e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6f01e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52714/0 (socket says 172.21.15.2:52714) 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1721055433 learned_addr learned my addr 172.21.15.2:0/1721055433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6efe00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f01e80f0 0x7ff6f01f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f01e80f0 msgr2=0x7ff6f01f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.731+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f01e80f0 0x7ff6f01f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6f01ebe40 msgr2=0x7ff6f01ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6f01ebe40 0x7ff6f01ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6f4c00640 1 -- 172.21.15.2:0/1721055433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f01ec790 con 0x7ff6d8003a80 2024-05-14T15:18:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6f4c00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6f01e9cb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff6e402a520 tx=0x7ff6e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e403f020 con 0x7ff6d8003a80 2024-05-14T15:18:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e4005480 con 0x7ff6d8003a80 2024-05-14T15:18:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f01ea1f0 con 0x7ff6d8003a80 2024-05-14T15:18:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.732+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4037040 con 0x7ff6d8003a80 2024-05-14T15:18:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.733+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f01e88b0 con 0x7ff6d8003a80 2024-05-14T15:18:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.734+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f0050870 con 0x7ff6d8003a80 2024-05-14T15:18:36.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.735+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6e4042020 con 0x7ff6d8003a80 2024-05-14T15:18:36.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.737+0000 7ff6ecc00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff6d00762d0 0x7ff6d00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:36.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.737+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7ff6e40b7760 con 0x7ff6d8003a80 2024-05-14T15:18:36.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.737+0000 7ff6efe00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff6d00762d0 0x7ff6d00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:36.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.739+0000 7ff6efe00640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff6d00762d0 0x7ff6d00787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0064510 tx=0x7ff6dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:36.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:36.742+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff6e4049020 con 0x7ff6d8003a80 2024-05-14T15:18:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.101+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff6f0074450 con 0x7ff6d8003a80 2024-05-14T15:18:37.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.102+0000 7ff6ecc00640 1 -- 172.21.15.2:0/1721055433 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1281 (secure 0 0 0) 0x7ff6f01ec790 con 0x7ff6d8003a80 2024-05-14T15:18:37.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:18:37.101 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","modified":"2024-05-14T15:14:42.309094Z","created":"2024-05-14T15:14:42.309094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3301","nonce":0},{"type":"v1","addr":"172.21.15.156:6790","nonce":0}]},"addr":"172.21.15.156:6790/0","public_addr":"172.21.15.156:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-14T15:18:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:dumped monmap epoch 1 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff6d00762d0 msgr2=0x7ff6d00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff6d00762d0 0x7ff6d00787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0064510 tx=0x7ff6dc008040 comp rx=0 tx=0).stop 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 msgr2=0x7ff6f01e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6f01e9cb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff6e402a520 tx=0x7ff6e4001120 comp rx=0 tx=0).stop 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 shutdown_connections 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ff6d00762d0 0x7ff6d00787e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6f01ebe40 0x7ff6f01ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6f01e80f0 0x7ff6f01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 --2- 172.21.15.2:0/1721055433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d8003a80 0x7ff6f01e9cb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 >> 172.21.15.2:0/1721055433 conn(0x7ff6f00732e0 msgr2=0x7ff6f0156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.105+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 shutdown_connections 2024-05-14T15:18:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.106+0000 7ff6f6000640 1 -- 172.21.15.2:0/1721055433 wait complete. 2024-05-14T15:18:37.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-05-14T15:18:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.383+0000 7fb374400640 1 Processor -- start 2024-05-14T15:18:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.383+0000 7fb374400640 1 -- start start 2024-05-14T15:18:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb374400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c06ce70 0x7fb36c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb374400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb36c162500 0x7fb36c162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb374400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36c06d7c0 con 0x7fb36c160740 2024-05-14T15:18:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb374400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb36c163ad0 con 0x7fb36c162500 2024-05-14T15:18:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb374400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c163230 con 0x7fb36c06ce70 2024-05-14T15:18:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb371000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb36c162500 0x7fb36c162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb371000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb36c162500 0x7fb36c162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52716/0 (socket says 172.21.15.2:52716) 2024-05-14T15:18:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.385+0000 7fb371000640 1 -- 172.21.15.2:0/246756606 learned_addr learned my addr 172.21.15.2:0/246756606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:18:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.386+0000 7fb371a00640 1 --2- 172.21.15.2:0/246756606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c06ce70 0x7fb36c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.386+0000 7fb371000640 1 -- 172.21.15.2:0/246756606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c06ce70 msgr2=0x7fb36c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:18:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.386+0000 7fb371000640 1 --2- 172.21.15.2:0/246756606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c06ce70 0x7fb36c06d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.386+0000 7fb371000640 1 -- 172.21.15.2:0/246756606 >> v1:172.21.15.156:6789/0 conn(0x7fb36c160740 legacy=0x7fb36c160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:18:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.386+0000 7fb371000640 1 -- 172.21.15.2:0/246756606 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c163510 con 0x7fb36c162500 2024-05-14T15:18:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.387+0000 7fb371000640 1 --2- 172.21.15.2:0/246756606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c162500 0x7fb36c162910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb35802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2d680f9562c2d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.387+0000 7fb36be00640 1 -- 172.21.15.2:0/246756606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358037070 con 0x7fb36c162500 2024-05-14T15:18:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb36be00640 1 -- 172.21.15.2:0/246756606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358032440 con 0x7fb36c162500 2024-05-14T15:18:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb36be00640 1 -- 172.21.15.2:0/246756606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358032810 con 0x7fb36c162500 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb374400640 1 -- 172.21.15.2:0/246756606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c162500 msgr2=0x7fb36c162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb374400640 1 --2- 172.21.15.2:0/246756606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c162500 0x7fb36c162910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb35802a1c0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb374400640 1 -- 172.21.15.2:0/246756606 shutdown_connections 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb374400640 1 --2- 172.21.15.2:0/246756606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c162500 0x7fb36c162910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb374400640 1 --2- 172.21.15.2:0/246756606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c06ce70 0x7fb36c06d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.388+0000 7fb374400640 1 -- 172.21.15.2:0/246756606 >> 172.21.15.2:0/246756606 conn(0x7fb36c073f10 msgr2=0x7fb36c09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.389+0000 7fb374400640 1 -- 172.21.15.2:0/246756606 shutdown_connections 2024-05-14T15:18:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.389+0000 7fb374400640 1 -- 172.21.15.2:0/246756606 wait complete. 2024-05-14T15:18:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.391+0000 7fb374400640 1 Processor -- start 2024-05-14T15:18:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.391+0000 7fb374400640 1 -- start start 2024-05-14T15:18:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb374400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 0x7fb36c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb374400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c160740 0x7fb36c1ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb374400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb36c162500 0x7fb36c0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb374400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c162e50 con 0x7fb36c06ce70 2024-05-14T15:18:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb374400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c0cea30 con 0x7fb36c162500 2024-05-14T15:18:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb374400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c162fd0 con 0x7fb36c160740 2024-05-14T15:18:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb371a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 0x7fb36c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb371a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 0x7fb36c144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52722/0 (socket says 172.21.15.2:52722) 2024-05-14T15:18:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.393+0000 7fb371a00640 1 -- 172.21.15.2:0/4203728621 learned_addr learned my addr 172.21.15.2:0/4203728621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:18:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371000640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c160740 0x7fb36c1ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb372400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb36c162500 0x7fb36c0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371a00640 1 -- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c160740 msgr2=0x7fb36c1ebe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371a00640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c160740 0x7fb36c1ebe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371a00640 1 -- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb36c162500 msgr2=0x7fb36c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371a00640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb36c162500 0x7fb36c0cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371a00640 1 -- 172.21.15.2:0/4203728621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c1ead10 con 0x7fb36c06ce70 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371000640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c160740 0x7fb36c1ebe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb372400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb36c162500 0x7fb36c0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb371a00640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 0x7fb36c144600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb36000d620 tx=0x7fb36000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36000b620 con 0x7fb36c06ce70 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360019070 con 0x7fb36c06ce70 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36000ba00 con 0x7fb36c06ce70 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.394+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36c1e8bf0 con 0x7fb36c06ce70 2024-05-14T15:18:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.395+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb36c1e91b0 con 0x7fb36c06ce70 2024-05-14T15:18:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.396+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36c050870 con 0x7fb36c06ce70 2024-05-14T15:18:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.398+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb36000bba0 con 0x7fb36c06ce70 2024-05-14T15:18:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.399+0000 7fb369600640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb34c076300 0x7fb34c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.399+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7fb360097d70 con 0x7fb36c06ce70 2024-05-14T15:18:37.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.400+0000 7fb371000640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb34c076300 0x7fb34c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.401+0000 7fb371000640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb34c076300 0x7fb34c078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb358034000 tx=0x7fb35802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:37.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.404+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb360061380 con 0x7fb36c06ce70 2024-05-14T15:18:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.692+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7fb36c071b60 con 0x7fb36c06ce70 2024-05-14T15:18:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.693+0000 7fb369600640 1 -- 172.21.15.2:0/4203728621 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v15) ==== 82+0+151 (secure 0 0 0) 0x7fb360060c80 con 0x7fb36c06ce70 2024-05-14T15:18:37.692 INFO:teuthology.orchestra.run.smithi002.stdout:[client.admin] 2024-05-14T15:18:37.693 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDif0NmgjmcLRAAthHg72B40cjBW9UMyAsd2A== 2024-05-14T15:18:37.693 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow *" 2024-05-14T15:18:37.693 INFO:teuthology.orchestra.run.smithi002.stdout: caps mgr = "allow *" 2024-05-14T15:18:37.693 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow *" 2024-05-14T15:18:37.693 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow *" 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb34c076300 msgr2=0x7fb34c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb34c076300 0x7fb34c078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb358034000 tx=0x7fb35802e000 comp rx=0 tx=0).stop 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 msgr2=0x7fb36c144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 0x7fb36c144600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb36000d620 tx=0x7fb36000dae0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 shutdown_connections 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fb34c076300 0x7fb34c078810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb36c162500 0x7fb36c0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb36c160740 0x7fb36c1ebe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 --2- 172.21.15.2:0/4203728621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb36c06ce70 0x7fb36c144600 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 >> 172.21.15.2:0/4203728621 conn(0x7fb36c073f10 msgr2=0x7fb36c071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.695+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 shutdown_connections 2024-05-14T15:18:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:18:37.696+0000 7fb374400640 1 -- 172.21.15.2:0/4203728621 wait complete. 2024-05-14T15:18:37.721 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-05-14T15:18:37.757 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.9CZvosQ6Nt 2024-05-14T15:18:37.757 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:18:37.757 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/tmp/tmp.9CZvosQ6Nt 2024-05-14T15:18:37.838 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:18:37.838 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/tmp/tmp.0ZOtQP6Hmyxfstests-dev/local.config 2024-05-14T15:18:37.938 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.JTI0kNNhc3test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.RYHUhQHDMxscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.2:6789 -k /tmp/tmp.9CZvosQ6Nt --client_mountpoint /test" 2024-05-14T15:18:37.939 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:18:37.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/tmp/tmp.0ZOtQP6Hmyxfstests-dev/ceph.exclude 2024-05-14T15:18:38.044 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.0ZOtQP6Hmyxfstests-dev && exec sudo make) 2024-05-14T15:18:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize -cfi 2024-05-14T15:18:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-14T15:18:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './config.guess' 2024-05-14T15:18:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './config.sub' 2024-05-14T15:18:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './install-sh' 2024-05-14T15:18:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './ltmain.sh' 2024-05-14T15:18:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-14T15:18:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-14T15:18:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-14T15:18:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-14T15:18:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-14T15:18:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-14T15:18:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-14T15:18:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:cp include/install-sh . 2024-05-14T15:18:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:aclocal -I m4 2024-05-14T15:18:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:autoheader 2024-05-14T15:18:41.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:41.077 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:autoconf 2024-05-14T15:18:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:./configure \ 2024-05-14T15:18:41.590 INFO:teuthology.orchestra.run.smithi002.stdout: --libexecdir=/usr/lib \ 2024-05-14T15:18:41.590 INFO:teuthology.orchestra.run.smithi002.stdout: --exec_prefix=/var/lib 2024-05-14T15:18:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-14T15:18:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-14T15:18:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to print strings... printf 2024-05-14T15:18:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc... gcc 2024-05-14T15:18:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether the C compiler works... yes 2024-05-14T15:18:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:checking for C compiler default output file name... a.out 2024-05-14T15:18:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:checking for suffix of executables... 2024-05-14T15:18:42.741 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether we are cross compiling... no 2024-05-14T15:18:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:checking for suffix of object files... o 2024-05-14T15:18:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether we are using the GNU C compiler... yes 2024-05-14T15:18:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether gcc accepts -g... yes 2024-05-14T15:18:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-14T15:18:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:checking for a sed that does not truncate output... /bin/sed 2024-05-14T15:18:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-05-14T15:18:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:checking for egrep... /bin/grep -E 2024-05-14T15:18:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:checking for fgrep... /bin/grep -F 2024-05-14T15:18:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ld used by gcc... /bin/ld 2024-05-14T15:18:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-05-14T15:18:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-05-14T15:18:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-05-14T15:18:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether ln -s works... yes 2024-05-14T15:18:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:checking the maximum length of command line arguments... 1572864 2024-05-14T15:18:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-14T15:18:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-14T15:18:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:checking for /bin/ld option to reload object files... -r 2024-05-14T15:18:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:checking for objdump... objdump 2024-05-14T15:18:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to recognize dependent libraries... pass_all 2024-05-14T15:18:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dlltool... no 2024-05-14T15:18:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-14T15:18:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ar... ar 2024-05-14T15:18:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:checking for archiver @FILE support... @ 2024-05-14T15:18:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:checking for strip... strip 2024-05-14T15:18:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ranlib... ranlib 2024-05-14T15:18:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gawk... gawk 2024-05-14T15:18:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-05-14T15:18:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sysroot... no 2024-05-14T15:18:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:checking for a working dd... /bin/dd 2024-05-14T15:18:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-05-14T15:18:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:checking for mt... no 2024-05-14T15:18:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:checking if : is a manifest tool... no 2024-05-14T15:18:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to run the C preprocessor... gcc -E 2024-05-14T15:18:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ANSI C header files... yes 2024-05-14T15:18:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/types.h... yes 2024-05-14T15:18:45.309 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/stat.h... yes 2024-05-14T15:18:45.387 INFO:teuthology.orchestra.run.smithi002.stdout:checking for stdlib.h... yes 2024-05-14T15:18:45.464 INFO:teuthology.orchestra.run.smithi002.stdout:checking for string.h... yes 2024-05-14T15:18:45.534 INFO:teuthology.orchestra.run.smithi002.stdout:checking for memory.h... yes 2024-05-14T15:18:45.614 INFO:teuthology.orchestra.run.smithi002.stdout:checking for strings.h... yes 2024-05-14T15:18:45.694 INFO:teuthology.orchestra.run.smithi002.stdout:checking for inttypes.h... yes 2024-05-14T15:18:45.774 INFO:teuthology.orchestra.run.smithi002.stdout:checking for stdint.h... yes 2024-05-14T15:18:45.870 INFO:teuthology.orchestra.run.smithi002.stdout:checking for unistd.h... yes 2024-05-14T15:18:45.943 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dlfcn.h... yes 2024-05-14T15:18:45.955 INFO:teuthology.orchestra.run.smithi002.stdout:checking for objdir... .libs 2024-05-14T15:18:46.140 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-14T15:18:46.141 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-14T15:18:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-14T15:18:46.273 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc static flag -static works... no 2024-05-14T15:18:46.359 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc supports -c -o file.o... yes 2024-05-14T15:18:46.360 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-14T15:18:46.387 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-14T15:18:46.465 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether -lc should be explicitly linked in... no 2024-05-14T15:18:46.620 INFO:teuthology.orchestra.run.smithi002.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-14T15:18:46.621 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to hardcode library paths into programs... immediate 2024-05-14T15:18:46.625 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether stripping libraries is possible... yes 2024-05-14T15:18:46.625 INFO:teuthology.orchestra.run.smithi002.stdout:checking if libtool supports shared libraries... yes 2024-05-14T15:18:46.625 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether to build shared libraries... yes 2024-05-14T15:18:46.625 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether to build static libraries... yes 2024-05-14T15:18:46.645 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc... (cached) gcc 2024-05-14T15:18:46.699 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-14T15:18:46.699 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-14T15:18:46.700 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-14T15:18:46.700 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gmake... /usr/bin/gmake 2024-05-14T15:18:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-05-14T15:18:46.701 INFO:teuthology.orchestra.run.smithi002.stdout:checking for tar... /bin/tar 2024-05-14T15:18:46.701 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gzip... /bin/gzip 2024-05-14T15:18:46.744 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether gcc -MM is supported... yes 2024-05-14T15:18:46.745 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sort... /bin/sort 2024-05-14T15:18:46.745 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether ln -s works... yes 2024-05-14T15:18:46.745 INFO:teuthology.orchestra.run.smithi002.stdout:checking for rpm... /bin/rpm 2024-05-14T15:18:46.757 INFO:teuthology.orchestra.run.smithi002.stdout:checking for rpmbuild... no 2024-05-14T15:18:46.825 INFO:teuthology.orchestra.run.smithi002.stdout:checking assert.h usability... yes 2024-05-14T15:18:46.855 INFO:teuthology.orchestra.run.smithi002.stdout:checking assert.h presence... yes 2024-05-14T15:18:46.855 INFO:teuthology.orchestra.run.smithi002.stdout:checking for assert.h... yes 2024-05-14T15:18:46.944 INFO:teuthology.orchestra.run.smithi002.stdout:checking bstring.h usability... no 2024-05-14T15:18:46.984 INFO:teuthology.orchestra.run.smithi002.stdout:checking bstring.h presence... no 2024-05-14T15:18:46.985 INFO:teuthology.orchestra.run.smithi002.stdout:checking for bstring.h... no 2024-05-14T15:18:47.061 INFO:teuthology.orchestra.run.smithi002.stdout:checking libgen.h usability... yes 2024-05-14T15:18:47.089 INFO:teuthology.orchestra.run.smithi002.stdout:checking libgen.h presence... yes 2024-05-14T15:18:47.089 INFO:teuthology.orchestra.run.smithi002.stdout:checking for libgen.h... yes 2024-05-14T15:18:47.174 INFO:teuthology.orchestra.run.smithi002.stdout:checking dirent.h usability... yes 2024-05-14T15:18:47.206 INFO:teuthology.orchestra.run.smithi002.stdout:checking dirent.h presence... yes 2024-05-14T15:18:47.206 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dirent.h... yes 2024-05-14T15:18:47.318 INFO:teuthology.orchestra.run.smithi002.stdout:checking errno.h usability... yes 2024-05-14T15:18:47.349 INFO:teuthology.orchestra.run.smithi002.stdout:checking errno.h presence... yes 2024-05-14T15:18:47.349 INFO:teuthology.orchestra.run.smithi002.stdout:checking for errno.h... yes 2024-05-14T15:18:47.444 INFO:teuthology.orchestra.run.smithi002.stdout:checking malloc.h usability... yes 2024-05-14T15:18:47.477 INFO:teuthology.orchestra.run.smithi002.stdout:checking malloc.h presence... yes 2024-05-14T15:18:47.478 INFO:teuthology.orchestra.run.smithi002.stdout:checking for malloc.h... yes 2024-05-14T15:18:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid.h usability... no 2024-05-14T15:18:47.605 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid.h presence... no 2024-05-14T15:18:47.605 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid.h... no 2024-05-14T15:18:47.678 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid/uuid.h usability... yes 2024-05-14T15:18:47.708 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid/uuid.h presence... yes 2024-05-14T15:18:47.709 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid/uuid.h... yes 2024-05-14T15:18:47.796 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/uuid.h usability... no 2024-05-14T15:18:47.840 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/uuid.h presence... no 2024-05-14T15:18:47.840 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/uuid.h... no 2024-05-14T15:18:47.919 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/file.h usability... yes 2024-05-14T15:18:47.950 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/file.h presence... yes 2024-05-14T15:18:47.950 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/file.h... yes 2024-05-14T15:18:48.036 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fcntl.h usability... yes 2024-05-14T15:18:48.066 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fcntl.h presence... yes 2024-05-14T15:18:48.067 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/fcntl.h... yes 2024-05-14T15:18:48.142 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/syssgi.h usability... no 2024-05-14T15:18:48.181 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/syssgi.h presence... no 2024-05-14T15:18:48.181 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/syssgi.h... no 2024-05-14T15:18:48.268 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/param.h usability... yes 2024-05-14T15:18:48.306 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/param.h presence... yes 2024-05-14T15:18:48.306 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/param.h... yes 2024-05-14T15:18:48.327 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/stat.h... (cached) yes 2024-05-14T15:18:48.411 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/statvfs.h usability... yes 2024-05-14T15:18:48.441 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/statvfs.h presence... yes 2024-05-14T15:18:48.441 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/statvfs.h... yes 2024-05-14T15:18:48.517 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/time.h usability... yes 2024-05-14T15:18:48.545 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/time.h presence... yes 2024-05-14T15:18:48.545 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/time.h... yes 2024-05-14T15:18:48.642 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/ioctl.h usability... yes 2024-05-14T15:18:48.679 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/ioctl.h presence... yes 2024-05-14T15:18:48.679 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/ioctl.h... yes 2024-05-14T15:18:48.772 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/wait.h usability... yes 2024-05-14T15:18:48.805 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/wait.h presence... yes 2024-05-14T15:18:48.805 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/wait.h... yes 2024-05-14T15:18:48.825 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/types.h... (cached) yes 2024-05-14T15:18:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:checking for strings.h... (cached) yes 2024-05-14T15:18:48.919 INFO:teuthology.orchestra.run.smithi002.stdout:checking err.h usability... yes 2024-05-14T15:18:48.952 INFO:teuthology.orchestra.run.smithi002.stdout:checking err.h presence... yes 2024-05-14T15:18:48.952 INFO:teuthology.orchestra.run.smithi002.stdout:checking for err.h... yes 2024-05-14T15:18:49.045 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/falloc.h usability... yes 2024-05-14T15:18:49.071 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/falloc.h presence... yes 2024-05-14T15:18:49.071 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/falloc.h... yes 2024-05-14T15:18:49.156 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-14T15:18:49.202 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-14T15:18:49.203 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-14T15:18:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-14T15:18:49.323 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-14T15:18:49.323 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-14T15:18:49.400 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/platform_defs.h usability... no 2024-05-14T15:18:49.444 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/platform_defs.h presence... no 2024-05-14T15:18:49.444 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/platform_defs.h... no 2024-05-14T15:18:49.521 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfs/ioctl.h usability... no 2024-05-14T15:18:49.566 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfs/ioctl.h presence... no 2024-05-14T15:18:49.566 INFO:teuthology.orchestra.run.smithi002.stdout:checking for btrfs/ioctl.h... no 2024-05-14T15:18:49.641 INFO:teuthology.orchestra.run.smithi002.stdout:checking cifs/ioctl.h usability... no 2024-05-14T15:18:49.685 INFO:teuthology.orchestra.run.smithi002.stdout:checking cifs/ioctl.h presence... no 2024-05-14T15:18:49.686 INFO:teuthology.orchestra.run.smithi002.stdout:checking for cifs/ioctl.h... no 2024-05-14T15:18:49.768 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/mman.h usability... yes 2024-05-14T15:18:49.796 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/mman.h presence... yes 2024-05-14T15:18:49.797 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/mman.h... yes 2024-05-14T15:18:49.881 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/ext4.h usability... no 2024-05-14T15:18:49.925 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/ext4.h presence... no 2024-05-14T15:18:49.926 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/ext4.h... no 2024-05-14T15:18:49.977 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/xfs_log_format.h... no 2024-05-14T15:18:50.084 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid_compare... no 2024-05-14T15:18:50.167 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid_compare in -luuid... yes 2024-05-14T15:18:50.299 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/xfs.h... yes 2024-05-14T15:18:50.350 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/libxfs.h... no 2024-05-14T15:18:50.417 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-14T15:18:50.498 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/xqm.h... yes 2024-05-14T15:18:50.606 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-14T15:18:50.671 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/handle.h usability... yes 2024-05-14T15:18:50.698 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/handle.h presence... yes 2024-05-14T15:18:50.698 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/handle.h... yes 2024-05-14T15:18:50.794 INFO:teuthology.orchestra.run.smithi002.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-14T15:18:50.866 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/acl.h usability... yes 2024-05-14T15:18:50.900 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/acl.h presence... yes 2024-05-14T15:18:50.901 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/acl.h... yes 2024-05-14T15:18:50.978 INFO:teuthology.orchestra.run.smithi002.stdout:checking acl/libacl.h usability... yes 2024-05-14T15:18:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:checking acl/libacl.h presence... yes 2024-05-14T15:18:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:checking for acl/libacl.h... yes 2024-05-14T15:18:51.104 INFO:teuthology.orchestra.run.smithi002.stdout:checking for acl_init in -lacl... yes 2024-05-14T15:18:51.176 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm-ndbm.h usability... no 2024-05-14T15:18:51.222 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm-ndbm.h presence... no 2024-05-14T15:18:51.223 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gdbm-ndbm.h... no 2024-05-14T15:18:51.288 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm/ndbm.h usability... yes 2024-05-14T15:18:51.323 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm/ndbm.h presence... yes 2024-05-14T15:18:51.323 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gdbm/ndbm.h... yes 2024-05-14T15:18:51.423 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_open in -lgdbm... no 2024-05-14T15:18:51.517 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_fetch in -lgdbm... no 2024-05-14T15:18:51.610 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_store in -lgdbm... no 2024-05-14T15:18:51.703 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_close in -lgdbm... no 2024-05-14T15:18:51.786 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-05-14T15:18:51.865 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-05-14T15:18:51.947 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-05-14T15:18:52.036 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-05-14T15:18:52.102 INFO:teuthology.orchestra.run.smithi002.stdout:checking libaio.h usability... yes 2024-05-14T15:18:52.134 INFO:teuthology.orchestra.run.smithi002.stdout:checking libaio.h presence... yes 2024-05-14T15:18:52.135 INFO:teuthology.orchestra.run.smithi002.stdout:checking for libaio.h... yes 2024-05-14T15:18:52.206 INFO:teuthology.orchestra.run.smithi002.stdout:checking liburing.h usability... no 2024-05-14T15:18:52.255 INFO:teuthology.orchestra.run.smithi002.stdout:checking liburing.h presence... no 2024-05-14T15:18:52.255 INFO:teuthology.orchestra.run.smithi002.stdout:checking for liburing.h... no 2024-05-14T15:18:52.332 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/capability.h usability... yes 2024-05-14T15:18:52.364 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/capability.h presence... yes 2024-05-14T15:18:52.364 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/capability.h... yes 2024-05-14T15:18:52.436 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fiemap.h usability... yes 2024-05-14T15:18:52.464 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fiemap.h presence... yes 2024-05-14T15:18:52.464 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/fiemap.h... yes 2024-05-14T15:18:52.554 INFO:teuthology.orchestra.run.smithi002.stdout:checking for fallocate... yes 2024-05-14T15:18:52.646 INFO:teuthology.orchestra.run.smithi002.stdout:checking for open_by_handle_at... yes 2024-05-14T15:18:52.713 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fs.h usability... yes 2024-05-14T15:18:52.740 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fs.h presence... yes 2024-05-14T15:18:52.740 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/fs.h... yes 2024-05-14T15:18:52.803 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfsutil.h usability... no 2024-05-14T15:18:52.847 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfsutil.h presence... no 2024-05-14T15:18:52.847 INFO:teuthology.orchestra.run.smithi002.stdout:checking for btrfsutil.h... no 2024-05-14T15:18:52.945 INFO:teuthology.orchestra.run.smithi002.stdout:checking for copy_file_range... yes 2024-05-14T15:18:53.041 INFO:teuthology.orchestra.run.smithi002.stdout:checking for SEEK_DATA... yes 2024-05-14T15:18:53.154 INFO:teuthology.orchestra.run.smithi002.stdout:checking for BMV_OF_SHARED... yes 2024-05-14T15:18:53.252 INFO:teuthology.orchestra.run.smithi002.stdout:checking for nftw... yes 2024-05-14T15:18:53.349 INFO:teuthology.orchestra.run.smithi002.stdout:checking for RLIMIT_NOFILE... yes 2024-05-14T15:18:53.433 INFO:teuthology.orchestra.run.smithi002.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-14T15:18:53.524 INFO:teuthology.orchestra.run.smithi002.stdout:checking for FICLONE... yes 2024-05-14T15:18:53.616 INFO:teuthology.orchestra.run.smithi002.stdout:checking for renameat2... yes 2024-05-14T15:18:53.708 INFO:teuthology.orchestra.run.smithi002.stdout:checking for reallocarray... yes 2024-05-14T15:18:53.811 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct mount_attr... yes 2024-05-14T15:18:53.930 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-14T15:18:54.046 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-14T15:18:54.160 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-14T15:18:54.270 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-14T15:18:54.380 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-14T15:18:54.493 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-14T15:18:54.599 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-14T15:18:54.680 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs.h usability... yes 2024-05-14T15:18:54.711 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs.h presence... yes 2024-05-14T15:18:54.712 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/btrfs.h... yes 2024-05-14T15:18:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-14T15:18:54.828 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-14T15:18:54.829 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/btrfs_tree.h... yes 2024-05-14T15:18:54.896 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-14T15:18:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-14T15:18:55.004 INFO:teuthology.orchestra.run.smithi002.stdout:configure: creating ./config.status 2024-05-14T15:18:56.216 INFO:teuthology.orchestra.run.smithi002.stdout:config.status: creating include/builddefs 2024-05-14T15:18:56.261 INFO:teuthology.orchestra.run.smithi002.stdout:config.status: creating include/config.h 2024-05-14T15:18:56.295 INFO:teuthology.orchestra.run.smithi002.stdout:config.status: executing libtool commands 2024-05-14T15:18:56.408 INFO:teuthology.orchestra.run.smithi002.stdout:Building include 2024-05-14T15:18:56.419 INFO:teuthology.orchestra.run.smithi002.stdout:Building lib 2024-05-14T15:18:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: [LTDEP] 2024-05-14T15:18:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dataascii.lo 2024-05-14T15:18:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] databin.lo 2024-05-14T15:18:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] datapid.lo 2024-05-14T15:18:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] file_lock.lo 2024-05-14T15:18:57.988 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] forker.lo 2024-05-14T15:18:58.291 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] pattern.lo 2024-05-14T15:18:58.561 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] open_flags.lo 2024-05-14T15:18:58.865 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] random_range.lo 2024-05-14T15:18:59.248 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] string_to_tokens.lo 2024-05-14T15:18:59.509 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] str_to_bytes.lo 2024-05-14T15:18:59.841 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] tlibio.lo 2024-05-14T15:19:00.251 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] write_log.lo 2024-05-14T15:19:00.665 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] random.lo 2024-05-14T15:19:00.923 INFO:teuthology.orchestra.run.smithi002.stdout: [LD] 2024-05-14T15:19:01.126 INFO:teuthology.orchestra.run.smithi002.stdout:Building ltp 2024-05-14T15:19:01.135 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2024-05-14T15:19:01.451 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] doio 2024-05-14T15:19:02.405 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsstress 2024-05-14T15:19:04.097 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsx 2024-05-14T15:19:05.054 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] growfiles 2024-05-14T15:19:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] iogen 2024-05-14T15:19:06.427 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-stress 2024-05-14T15:19:07.075 INFO:teuthology.orchestra.run.smithi002.stdout:Building src 2024-05-14T15:19:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2024-05-14T15:19:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2024-05-14T15:19:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2024-05-14T15:19:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2024-05-14T15:19:11.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:19:11.495 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:19:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2024-05-14T15:19:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dirstress 2024-05-14T15:19:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fill 2024-05-14T15:19:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fill2 2024-05-14T15:19:13.131 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] getpagesize 2024-05-14T15:19:13.433 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] holes 2024-05-14T15:19:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] lstat64 2024-05-14T15:19:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] nametest 2024-05-14T15:19:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] permname 2024-05-14T15:19:15.072 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] randholes 2024-05-14T15:19:15.566 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] runas 2024-05-14T15:19:15.925 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] truncfile 2024-05-14T15:19:16.302 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] usemem 2024-05-14T15:19:16.644 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mmapcat 2024-05-14T15:19:16.956 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] append_reader 2024-05-14T15:19:17.289 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] append_writer 2024-05-14T15:19:17.635 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dirperf 2024-05-14T15:19:18.063 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] metaperf 2024-05-14T15:19:18.574 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] devzero 2024-05-14T15:19:18.950 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] feature 2024-05-14T15:19:19.381 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] alloc 2024-05-14T15:19:19.770 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fault 2024-05-14T15:19:20.131 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fstest 2024-05-14T15:19:20.584 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_access_root 2024-05-14T15:19:20.922 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] godown 2024-05-14T15:19:21.295 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] resvtest 2024-05-14T15:19:21.688 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] writemod 2024-05-14T15:19:22.028 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] writev_on_pagefault 2024-05-14T15:19:22.375 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] makeextents 2024-05-14T15:19:22.742 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] itrash 2024-05-14T15:19:23.090 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] rename 2024-05-14T15:19:23.415 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] multi_open_unlink 2024-05-14T15:19:23.747 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] unwritten_sync 2024-05-14T15:19:24.132 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] genhashnames 2024-05-14T15:19:24.515 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_holes 2024-05-14T15:19:24.872 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_writev 2024-05-14T15:19:25.232 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_truncate_cmtime 2024-05-14T15:19:25.577 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dirhash_collide 2024-05-14T15:19:26.003 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_rename_overwrite 2024-05-14T15:19:26.311 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] holetest 2024-05-14T15:19:26.737 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_truncate_self 2024-05-14T15:19:27.041 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] af_unix 2024-05-14T15:19:27.373 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_stale_pmd 2024-05-14T15:19:27.711 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_cow_race 2024-05-14T15:19:28.074 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_fallocate 2024-05-14T15:19:28.412 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsync-err 2024-05-14T15:19:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_write_ro 2024-05-14T15:19:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-14T15:19:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-14T15:19:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_ofd_locks 2024-05-14T15:19:30.202 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_collision 2024-05-14T15:19:30.621 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mmap-write-concurrent 2024-05-14T15:19:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_get_file_time 2024-05-14T15:19:31.342 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_create_short_dirs 2024-05-14T15:19:31.681 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_create_long_dirs 2024-05-14T15:19:32.041 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_enospc 2024-05-14T15:19:32.409 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_writev_overlap 2024-05-14T15:19:32.757 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] checkpoint_journal 2024-05-14T15:19:33.108 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mmap-rw-fault 2024-05-14T15:19:33.493 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] allocstale 2024-05-14T15:19:33.866 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_cow_memory_failure 2024-05-14T15:19:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fake-dump-rootino 2024-05-14T15:19:34.565 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dio-buf-fault 2024-05-14T15:19:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] rewinddir-test 2024-05-14T15:19:35.268 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] readdir-while-renames 2024-05-14T15:19:35.601 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] xfsctl 2024-05-14T15:19:35.995 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bstat 2024-05-14T15:19:36.422 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mtab 2024-05-14T15:19:36.787 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] getdevicesize 2024-05-14T15:19:37.123 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] preallo_rw_pattern_reader 2024-05-14T15:19:37.491 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] preallo_rw_pattern_writer 2024-05-14T15:19:37.859 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] ftrunc 2024-05-14T15:19:38.202 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] trunc 2024-05-14T15:19:38.537 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fs_perms 2024-05-14T15:19:38.904 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] testx 2024-05-14T15:19:39.210 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] looptest 2024-05-14T15:19:39.576 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] locktest 2024-05-14T15:19:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] unwritten_mmap 2024-05-14T15:19:40.407 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bulkstat_unlink_test 2024-05-14T15:19:40.816 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] deduperace 2024-05-14T15:19:41.205 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bulkstat_unlink_test_modified 2024-05-14T15:19:41.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:19:41.623 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:19:41.624 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_dir_offset 2024-05-14T15:19:41.922 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_futimens 2024-05-14T15:19:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_immutable 2024-05-14T15:19:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] stale_handle 2024-05-14T15:19:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] pwrite_mmap_blocked 2024-05-14T15:19:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_dir_offset2 2024-05-14T15:19:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] seek_sanity_test 2024-05-14T15:19:44.869 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] seek_copy_test 2024-05-14T15:19:45.253 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_readdir_1 2024-05-14T15:19:45.588 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_readdir_2 2024-05-14T15:19:45.937 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsync-tester 2024-05-14T15:19:46.396 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] nsexec 2024-05-14T15:19:46.780 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] cloner 2024-05-14T15:19:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] renameat2 2024-05-14T15:19:47.548 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_getcwd 2024-05-14T15:19:47.922 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] e4compact 2024-05-14T15:19:48.337 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] test-nextquota 2024-05-14T15:19:48.722 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] punch-alternating 2024-05-14T15:19:49.108 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-14T15:19:49.485 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] listxattr 2024-05-14T15:19:49.805 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dio-interleaved 2024-05-14T15:19:50.172 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_dir_type 2024-05-14T15:19:50.535 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dio-invalidate-cache 2024-05-14T15:19:50.934 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] stat_test 2024-05-14T15:19:51.467 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_encrypted_d_revalidate 2024-05-14T15:19:51.828 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] attr_replace_test 2024-05-14T15:19:52.198 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] swapon 2024-05-14T15:19:52.575 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mkswap 2024-05-14T15:19:52.910 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_attr_corruption 2024-05-14T15:19:53.223 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_open_tmpfiles 2024-05-14T15:19:53.599 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fscrypt-crypt-util 2024-05-14T15:19:54.530 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bulkstat_null_ocount 2024-05-14T15:19:54.899 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] splice-test 2024-05-14T15:19:55.257 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] chprojid_fail 2024-05-14T15:19:55.615 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] detached_mounts_propagation 2024-05-14T15:19:56.001 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] ext4_resize 2024-05-14T15:19:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_readdir_3 2024-05-14T15:19:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] splice2pipe 2024-05-14T15:19:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] uuid_ioctl 2024-05-14T15:19:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-14T15:19:57.809 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fiemap-fault 2024-05-14T15:19:58.112 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fiemap-tester 2024-05-14T15:19:58.592 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_stripealign 2024-05-14T15:19:58.941 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] open_by_handle 2024-05-14T15:19:59.402 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dbtest 2024-05-14T15:19:59.890 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_dio 2024-05-14T15:20:00.255 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] xfsfind 2024-05-14T15:20:00.665 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_reflink_read_race 2024-05-14T15:20:01.086 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fssum 2024-05-14T15:20:01.750 INFO:teuthology.orchestra.run.smithi002.stdout:Building log-writes 2024-05-14T15:20:01.766 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] replay-log 2024-05-14T15:20:02.322 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2024-05-14T15:20:02.333 INFO:teuthology.orchestra.run.smithi002.stdout:Building aio-dio-regress 2024-05-14T15:20:02.349 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aiocp 2024-05-14T15:20:02.754 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-14T15:20:03.102 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-append-write-read-race 2024-05-14T15:20:03.442 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-cow-race 2024-05-14T15:20:03.772 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-cycle-write 2024-05-14T15:20:04.175 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-eof-race 2024-05-14T15:20:04.534 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-extend-stat 2024-05-14T15:20:04.893 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-fcntl-race 2024-05-14T15:20:05.265 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-hole-filling-race 2024-05-14T15:20:05.620 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-invalidate-failure 2024-05-14T15:20:05.976 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-invalidate-readahead 2024-05-14T15:20:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aiodio_sparse2 2024-05-14T15:20:06.754 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-subblock-eof-read 2024-05-14T15:20:07.101 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-write-verify 2024-05-14T15:20:07.521 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-14T15:20:07.860 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-14T15:20:08.185 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-last-ref-held-by-io 2024-05-14T15:20:08.535 INFO:teuthology.orchestra.run.smithi002.stdout:Building vfs 2024-05-14T15:20:08.550 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] vfstest 2024-05-14T15:20:11.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:20:11.754 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:20:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mount-idmapped 2024-05-14T15:20:13.384 INFO:teuthology.orchestra.run.smithi002.stdout:Building m4 2024-05-14T15:20:13.396 INFO:teuthology.orchestra.run.smithi002.stdout:Building common 2024-05-14T15:20:13.408 INFO:teuthology.orchestra.run.smithi002.stdout:Building tests 2024-05-14T15:20:13.426 INFO:teuthology.orchestra.run.smithi002.stdout:Building btrfs 2024-05-14T15:20:13.443 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/btrfs/group.list 2024-05-14T15:20:13.684 INFO:teuthology.orchestra.run.smithi002.stdout:Building ceph 2024-05-14T15:20:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ceph/group.list 2024-05-14T15:20:13.758 INFO:teuthology.orchestra.run.smithi002.stdout:Building cifs 2024-05-14T15:20:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/cifs/group.list 2024-05-14T15:20:13.823 INFO:teuthology.orchestra.run.smithi002.stdout:Building ext4 2024-05-14T15:20:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ext4/group.list 2024-05-14T15:20:13.993 INFO:teuthology.orchestra.run.smithi002.stdout:Building f2fs 2024-05-14T15:20:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/f2fs/group.list 2024-05-14T15:20:14.078 INFO:teuthology.orchestra.run.smithi002.stdout:Building generic 2024-05-14T15:20:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/generic/group.list 2024-05-14T15:20:14.484 INFO:teuthology.orchestra.run.smithi002.stdout:Building nfs 2024-05-14T15:20:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/nfs/group.list 2024-05-14T15:20:14.560 INFO:teuthology.orchestra.run.smithi002.stdout:Building ocfs2 2024-05-14T15:20:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ocfs2/group.list 2024-05-14T15:20:14.629 INFO:teuthology.orchestra.run.smithi002.stdout:Building overlay 2024-05-14T15:20:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/overlay/group.list 2024-05-14T15:20:14.807 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2024-05-14T15:20:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/perf/group.list 2024-05-14T15:20:14.867 INFO:teuthology.orchestra.run.smithi002.stdout:Building selftest 2024-05-14T15:20:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/selftest/group.list 2024-05-14T15:20:14.930 INFO:teuthology.orchestra.run.smithi002.stdout:Building shared 2024-05-14T15:20:14.946 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/shared/group.list 2024-05-14T15:20:15.017 INFO:teuthology.orchestra.run.smithi002.stdout:Building tmpfs 2024-05-14T15:20:15.032 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/tmpfs/group.list 2024-05-14T15:20:15.085 INFO:teuthology.orchestra.run.smithi002.stdout:Building udf 2024-05-14T15:20:15.101 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/udf/group.list 2024-05-14T15:20:15.146 INFO:teuthology.orchestra.run.smithi002.stdout:Building xfs 2024-05-14T15:20:15.162 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/xfs/group.list 2024-05-14T15:20:15.564 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.0ZOtQP6Hmyxfstests-dev && exec sudo make install) 2024-05-14T15:20:15.686 INFO:teuthology.orchestra.run.smithi002.stdout:Building include 2024-05-14T15:20:15.697 INFO:teuthology.orchestra.run.smithi002.stdout:Building lib 2024-05-14T15:20:15.709 INFO:teuthology.orchestra.run.smithi002.stdout:Building ltp 2024-05-14T15:20:15.721 INFO:teuthology.orchestra.run.smithi002.stdout:Building src 2024-05-14T15:20:15.810 INFO:teuthology.orchestra.run.smithi002.stdout:Building log-writes 2024-05-14T15:20:15.820 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2024-05-14T15:20:15.831 INFO:teuthology.orchestra.run.smithi002.stdout:Building aio-dio-regress 2024-05-14T15:20:15.843 INFO:teuthology.orchestra.run.smithi002.stdout:Building vfs 2024-05-14T15:20:15.855 INFO:teuthology.orchestra.run.smithi002.stdout:Building m4 2024-05-14T15:20:15.865 INFO:teuthology.orchestra.run.smithi002.stdout:Building common 2024-05-14T15:20:15.877 INFO:teuthology.orchestra.run.smithi002.stdout:Building tests 2024-05-14T15:20:15.891 INFO:teuthology.orchestra.run.smithi002.stdout:Building btrfs 2024-05-14T15:20:15.909 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/btrfs/group.list 2024-05-14T15:20:16.134 INFO:teuthology.orchestra.run.smithi002.stdout:Building ceph 2024-05-14T15:20:16.149 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ceph/group.list 2024-05-14T15:20:16.204 INFO:teuthology.orchestra.run.smithi002.stdout:Building cifs 2024-05-14T15:20:16.218 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/cifs/group.list 2024-05-14T15:20:16.266 INFO:teuthology.orchestra.run.smithi002.stdout:Building ext4 2024-05-14T15:20:16.281 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ext4/group.list 2024-05-14T15:20:16.429 INFO:teuthology.orchestra.run.smithi002.stdout:Building f2fs 2024-05-14T15:20:16.444 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/f2fs/group.list 2024-05-14T15:20:16.513 INFO:teuthology.orchestra.run.smithi002.stdout:Building generic 2024-05-14T15:20:16.532 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/generic/group.list 2024-05-14T15:20:16.943 INFO:teuthology.orchestra.run.smithi002.stdout:Building nfs 2024-05-14T15:20:16.960 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/nfs/group.list 2024-05-14T15:20:17.017 INFO:teuthology.orchestra.run.smithi002.stdout:Building ocfs2 2024-05-14T15:20:17.032 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ocfs2/group.list 2024-05-14T15:20:17.085 INFO:teuthology.orchestra.run.smithi002.stdout:Building overlay 2024-05-14T15:20:17.101 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/overlay/group.list 2024-05-14T15:20:17.261 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2024-05-14T15:20:17.276 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/perf/group.list 2024-05-14T15:20:17.321 INFO:teuthology.orchestra.run.smithi002.stdout:Building selftest 2024-05-14T15:20:17.337 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/selftest/group.list 2024-05-14T15:20:17.385 INFO:teuthology.orchestra.run.smithi002.stdout:Building shared 2024-05-14T15:20:17.401 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/shared/group.list 2024-05-14T15:20:17.469 INFO:teuthology.orchestra.run.smithi002.stdout:Building tmpfs 2024-05-14T15:20:17.485 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/tmpfs/group.list 2024-05-14T15:20:17.536 INFO:teuthology.orchestra.run.smithi002.stdout:Building udf 2024-05-14T15:20:17.551 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/udf/group.list 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi002.stdout:Building xfs 2024-05-14T15:20:17.612 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/xfs/group.list 2024-05-14T15:20:18.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-14T15:20:18.017 INFO:teuthology.orchestra.run.smithi002.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T15:20:18.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-14T15:20:18.024 INFO:teuthology.orchestra.run.smithi002.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T15:20:18.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-14T15:20:18.030 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-14T15:20:18.066 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-14T15:20:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-14T15:20:18.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-14T15:20:18.404 INFO:teuthology.orchestra.run.smithi002.stdout:Building log-writes 2024-05-14T15:20:18.416 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2024-05-14T15:20:18.427 INFO:teuthology.orchestra.run.smithi002.stdout:Building aio-dio-regress 2024-05-14T15:20:18.440 INFO:teuthology.orchestra.run.smithi002.stdout:Building vfs 2024-05-14T15:20:18.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C log-writes install 2024-05-14T15:20:18.453 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-14T15:20:18.487 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-14T15:20:18.520 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C perf install 2024-05-14T15:20:18.524 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-14T15:20:18.556 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-14T15:20:18.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-14T15:20:18.649 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-14T15:20:18.683 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-05-14T15:20:18.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C vfs install 2024-05-14T15:20:18.888 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-14T15:20:18.922 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-14T15:20:18.970 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-14T15:20:19.005 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-14T15:20:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-14T15:20:24.145 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-14T15:20:24.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-14T15:20:24.228 INFO:teuthology.orchestra.run.smithi002.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T15:20:24.228 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-14T15:20:24.232 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-14T15:20:24.266 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-14T15:20:24.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-14T15:20:24.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/btrfs/ install 2024-05-14T15:20:24.835 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/btrfs/group.list 2024-05-14T15:20:25.041 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-14T15:20:25.072 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 313 314 315 316 317 318 320 330 /var/lib/xfstests/tests/btrfs 2024-05-14T15:20:28.707 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-14T15:20:28.740 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 313.out 314.out 315.out 316.out 317.out 318.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-05-14T15:20:32.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ceph/ install 2024-05-14T15:20:32.509 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ceph/group.list 2024-05-14T15:20:32.563 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-14T15:20:32.596 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-14T15:20:32.669 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-14T15:20:32.701 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-05-14T15:20:32.778 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/cifs/ install 2024-05-14T15:20:32.786 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/cifs/group.list 2024-05-14T15:20:32.832 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-14T15:20:32.867 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-14T15:20:32.902 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-14T15:20:32.937 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-14T15:20:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ext4/ install 2024-05-14T15:20:32.981 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ext4/group.list 2024-05-14T15:20:33.124 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-14T15:20:33.156 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-14T15:20:33.888 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-14T15:20:33.923 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-05-14T15:20:34.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/f2fs/ install 2024-05-14T15:20:34.734 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/f2fs/group.list 2024-05-14T15:20:34.799 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-14T15:20:34.835 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-14T15:20:34.880 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-14T15:20:34.916 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-14T15:20:34.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/generic/ install 2024-05-14T15:20:34.973 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/generic/group.list 2024-05-14T15:20:35.387 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-14T15:20:35.422 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 744 /var/lib/xfstests/tests/generic 2024-05-14T15:20:41.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:20:41.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:20:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-14T15:20:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out 744.out /var/lib/xfstests/tests/generic 2024-05-14T15:20:52.593 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/nfs/ install 2024-05-14T15:20:52.603 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/nfs/group.list 2024-05-14T15:20:52.656 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-14T15:20:52.690 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-14T15:20:52.723 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-14T15:20:52.755 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-14T15:20:52.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ocfs2/ install 2024-05-14T15:20:52.796 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/ocfs2/group.list 2024-05-14T15:20:52.846 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-14T15:20:52.879 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-14T15:20:52.914 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-14T15:20:52.947 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-14T15:20:52.982 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/overlay/ install 2024-05-14T15:20:52.990 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/overlay/group.list 2024-05-14T15:20:53.146 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-14T15:20:53.179 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-14T15:20:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-14T15:20:54.484 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-05-14T15:20:55.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/perf/ install 2024-05-14T15:20:55.640 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/perf/group.list 2024-05-14T15:20:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-14T15:20:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-14T15:20:55.751 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-14T15:20:55.785 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-14T15:20:55.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/selftest/ install 2024-05-14T15:20:55.827 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/selftest/group.list 2024-05-14T15:20:55.874 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-14T15:20:55.909 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-14T15:20:55.994 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-14T15:20:56.027 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-05-14T15:20:56.115 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/shared/ install 2024-05-14T15:20:56.122 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/shared/group.list 2024-05-14T15:20:56.188 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-14T15:20:56.224 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-14T15:20:56.280 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-14T15:20:56.316 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-05-14T15:20:56.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/tmpfs/ install 2024-05-14T15:20:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/tmpfs/group.list 2024-05-14T15:20:56.431 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-14T15:20:56.466 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-14T15:20:56.501 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-14T15:20:56.536 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-14T15:20:56.572 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/udf/ install 2024-05-14T15:20:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/udf/group.list 2024-05-14T15:20:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-14T15:20:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-14T15:20:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-14T15:20:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-14T15:20:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/xfs/ install 2024-05-14T15:20:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.0ZOtQP6Hmyxfstests-dev/tests/xfs/group.list 2024-05-14T15:20:57.150 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-14T15:20:57.184 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 612 613 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-14T15:21:05.462 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-14T15:21:05.498 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 612.out 613.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-05-14T15:21:12.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:21:12.017 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:21:13.316 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-14T15:21:13.349 INFO:teuthology.orchestra.run.smithi002.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-14T15:21:13.376 INFO:teuthology.orchestra.run.smithi002.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-14T15:21:13.406 INFO:teuthology.orchestra.run.smithi002.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-14T15:21:13.444 INFO:tasks.cephfs.test_acls:client is fuse mounted 2024-05-14T15:21:13.444 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-14T15:21:13.444 DEBUG:teuthology.orchestra.run.smithi002:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.0ZOtQP6Hmyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-14T15:21:13.906 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2024-05-14T15:21:13.919 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 6.9.0-rc3-gfb9a6a44107e #1 SMP PREEMPT_DYNAMIC Fri May 10 02:34:55 UTC 2024 2024-05-14T15:21:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:14.978 INFO:teuthology.orchestra.run.smithi002.stdout:generic/099 1s 2024-05-14T15:21:14.996 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/099 2024-05-14T15:21:14.996 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2024-05-14T15:21:15.006 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:15.010 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[47838]: fuse finished with error 0 and tester_r 0 2024-05-14T15:21:15.038 INFO:tasks.cephfs.test_acls:Command return value: 0 2024-05-14T15:21:15.038 INFO:tasks.cephfs.test_acls:Command stdout - FSTYP -- ceph-fuse PLATFORM -- Linux/x86_64 smithi002 6.9.0-rc3-gfb9a6a44107e #1 SMP PREEMPT_DYNAMIC Fri May 10 02:34:55 UTC 2024 generic/099 1s Ran: generic/099 Passed all 1 tests 2024-05-14T15:21:15.038 INFO:tasks.cephfs.test_acls:Command stderr - 2024-05-14T15:21:15.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo userdel --force --remove fsgqa 2024-05-14T15:21:15.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo userdel --force --remove 123456-fsgqa 2024-05-14T15:21:16.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo groupdel fsgqa 2024-05-14T15:21:16.531 INFO:teuthology.orchestra.run.smithi002.stderr:groupdel: group 'fsgqa' does not exist 2024-05-14T15:21:16.536 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-14T15:21:16.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:16.537 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.0ZOtQP6Hmyxfstests-dev/results) 2024-05-14T15:21:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-05-14T15:21:16.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:21:16.593 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.0ZOtQP6Hmyxfstests-dev 2024-05-14T15:21:16.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf /tmp/tmp.0ZOtQP6Hmyxfstests-dev 2024-05-14T15:21:16.939 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-14T15:21:16.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T15:21:17.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T15:21:17.150 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-14T15:21:17.150 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T15:21:17.151 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:21:17.151 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:17.211 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T15:21:17.211 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T15:21:17.211 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:21:17.211 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:17.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T15:21:17.269 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T15:21:17.269 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:21:17.269 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:17.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T15:21:17.328 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T15:21:17.328 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:21:17.328 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:17.385 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T15:21:17.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:21:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.681+0000 7f8308600640 1 Processor -- start 2024-05-14T15:21:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.682+0000 7f8308600640 1 -- start start 2024-05-14T15:21:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.684+0000 7f8308600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8300071530 0x7f83000af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.684+0000 7f8308600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f830006d700 0x7f830006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.684+0000 7f8308600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83000d1460 con 0x7f830015bb90 2024-05-14T15:21:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.684+0000 7f8308600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f830015eb50 con 0x7f830006d700 2024-05-14T15:21:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.684+0000 7f8308600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f830015f350 con 0x7f8300071530 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f830006d700 0x7f830006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f830006d700 0x7f830006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57624/0 (socket says 172.21.15.2:57624) 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 -- 172.21.15.2:0/1255266052 learned_addr learned my addr 172.21.15.2:0/1255266052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8305200640 1 --2- 172.21.15.2:0/1255266052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8300071530 0x7f83000af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 -- 172.21.15.2:0/1255266052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8300071530 msgr2=0x7f83000af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 --2- 172.21.15.2:0/1255266052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8300071530 0x7f83000af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 -- 172.21.15.2:0/1255266052 >> v1:172.21.15.156:6789/0 conn(0x7f830015bb90 legacy=0x7f830015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.685+0000 7f8306600640 1 -- 172.21.15.2:0/1255266052 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830006e050 con 0x7f830006d700 2024-05-14T15:21:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.686+0000 7f8306600640 1 --2- 172.21.15.2:0/1255266052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830006d700 0x7f830006db10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009e50 tx=0x7f82f802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9fbb97832d2c7e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.687+0000 7f82ffe00640 1 -- 172.21.15.2:0/1255266052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8036070 con 0x7f830006d700 2024-05-14T15:21:17.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.687+0000 7f82ffe00640 1 -- 172.21.15.2:0/1255266052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f8031600 con 0x7f830006d700 2024-05-14T15:21:17.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.687+0000 7f82ffe00640 1 -- 172.21.15.2:0/1255266052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80319d0 con 0x7f830006d700 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 -- 172.21.15.2:0/1255266052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830006d700 msgr2=0x7f830006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 --2- 172.21.15.2:0/1255266052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830006d700 0x7f830006db10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009e50 tx=0x7f82f802a5f0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 -- 172.21.15.2:0/1255266052 shutdown_connections 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 --2- 172.21.15.2:0/1255266052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f830006d700 0x7f830006db10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 --2- 172.21.15.2:0/1255266052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8300071530 0x7f83000af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 -- 172.21.15.2:0/1255266052 >> 172.21.15.2:0/1255266052 conn(0x7f83000d1d10 msgr2=0x7f83000734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 -- 172.21.15.2:0/1255266052 shutdown_connections 2024-05-14T15:21:17.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.688+0000 7f8308600640 1 -- 172.21.15.2:0/1255266052 wait complete. 2024-05-14T15:21:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.690+0000 7f8308600640 1 Processor -- start 2024-05-14T15:21:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.690+0000 7f8308600640 1 -- start start 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8308600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830006d700 0x7f8300158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8308600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 0x7f83000cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8308600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830015bb90 0x7f83000cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8308600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83000ae880 con 0x7f8300071530 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8308600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f830015f070 con 0x7f830015bb90 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8308600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f83000aeb60 con 0x7f830006d700 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8305200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 0x7f83000cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8305200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 0x7f83000cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57628/0 (socket says 172.21.15.2:57628) 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.692+0000 7f8305200640 1 -- 172.21.15.2:0/179256527 learned_addr learned my addr 172.21.15.2:0/179256527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305c00640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830006d700 0x7f8300158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8306600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830015bb90 0x7f83000cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305200640 1 -- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830006d700 msgr2=0x7f8300158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305200640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830006d700 0x7f8300158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305200640 1 -- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830015bb90 msgr2=0x7f83000cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305200640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830015bb90 0x7f83000cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305200640 1 -- 172.21.15.2:0/179256527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83000cd1a0 con 0x7f8300071530 2024-05-14T15:21:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.693+0000 7f8305200640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 0x7f83000cc440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00d5f0 tx=0x7f82ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.694+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0125f0 con 0x7f8300071530 2024-05-14T15:21:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.694+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec019070 con 0x7f8300071530 2024-05-14T15:21:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.694+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0129d0 con 0x7f8300071530 2024-05-14T15:21:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.694+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83000cd480 con 0x7f8300071530 2024-05-14T15:21:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.694+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830014ea80 con 0x7f8300071530 2024-05-14T15:21:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.695+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83000ccf10 con 0x7f8300071530 2024-05-14T15:21:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.697+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82ec012b70 con 0x7f8300071530 2024-05-14T15:21:17.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.698+0000 7f82fd600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f82e0076300 0x7f82e0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:17.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.698+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7f82ec097d60 con 0x7f8300071530 2024-05-14T15:21:17.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.698+0000 7f8305c00640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f82e0076300 0x7f82e0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.700+0000 7f8305c00640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f82e0076300 0x7f82e0078810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82f4006fd0 tx=0x7f82f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.703+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82ec061370 con 0x7f8300071530 2024-05-14T15:21:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.955+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8300050870 con 0x7f8300071530 2024-05-14T15:21:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.956+0000 7f82fd600640 1 -- 172.21.15.2:0/179256527 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f82ec060c70 con 0x7f8300071530 2024-05-14T15:21:17.957 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:17.957 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:17:08.156565+0000","modified":"2024-05-14T15:17:11.317343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.2:6835/3645921439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3645921439},{"type":"v1","addr":"172.21.15.2:6835","nonce":3645921439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4947,"qdb_cluster":[4947]},"id":2}]} 2024-05-14T15:21:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f82e0076300 msgr2=0x7f82e0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f82e0076300 0x7f82e0078810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82f4006fd0 tx=0x7f82f4008040 comp rx=0 tx=0).stop 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 msgr2=0x7f83000cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 0x7f83000cc440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00d5f0 tx=0x7f82ec00dab0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 shutdown_connections 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f82e0076300 0x7f82e0078810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830015bb90 0x7f83000cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8300071530 0x7f83000cc440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 --2- 172.21.15.2:0/179256527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830006d700 0x7f8300158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.959+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 >> 172.21.15.2:0/179256527 conn(0x7f83000d1d10 msgr2=0x7f8300159370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.960+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 shutdown_connections 2024-05-14T15:21:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:17.960+0000 7f8308600640 1 -- 172.21.15.2:0/179256527 wait complete. 2024-05-14T15:21:17.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:21:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.266+0000 7fca17800640 1 Processor -- start 2024-05-14T15:21:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.266+0000 7fca17800640 1 -- start start 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca17800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca100706e0 0x7fca10160070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca17800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca1006d700 0x7fca1006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca17800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1006e050 con 0x7fca100b4690 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca17800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fca100b4e00 con 0x7fca1006d700 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca17800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fca100b50e0 con 0x7fca100706e0 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca15800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca1006d700 0x7fca1006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca15800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca1006d700 0x7fca1006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57638/0 (socket says 172.21.15.2:57638) 2024-05-14T15:21:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.269+0000 7fca15800640 1 -- 172.21.15.2:0/2602571108 learned_addr learned my addr 172.21.15.2:0/2602571108 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.270+0000 7fca14e00640 1 --2- 172.21.15.2:0/2602571108 >> v2:172.21.15.156:3300/0 conn(0x7fca100706e0 0x7fca10160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.270+0000 7fca15800640 1 -- 172.21.15.2:0/2602571108 >> v2:172.21.15.156:3300/0 conn(0x7fca100706e0 msgr2=0x7fca10160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.270+0000 7fca15800640 1 --2- 172.21.15.2:0/2602571108 >> v2:172.21.15.156:3300/0 conn(0x7fca100706e0 0x7fca10160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.270+0000 7fca15800640 1 -- 172.21.15.2:0/2602571108 >> v1:172.21.15.2:6789/0 conn(0x7fca100b4690 legacy=0x7fca10164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.270+0000 7fca15800640 1 -- 172.21.15.2:0/2602571108 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca100b53c0 con 0x7fca1006d700 2024-05-14T15:21:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.271+0000 7fca15800640 1 --2- 172.21.15.2:0/2602571108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1006db10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fca10073470 tx=0x7fca0802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7280f56f17abd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.271+0000 7fca0f400640 1 -- 172.21.15.2:0/2602571108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08036070 con 0x7fca1006d700 2024-05-14T15:21:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.271+0000 7fca0f400640 1 -- 172.21.15.2:0/2602571108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08031600 con 0x7fca1006d700 2024-05-14T15:21:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.271+0000 7fca0f400640 1 -- 172.21.15.2:0/2602571108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080319d0 con 0x7fca1006d700 2024-05-14T15:21:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 -- 172.21.15.2:0/2602571108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 msgr2=0x7fca1006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 --2- 172.21.15.2:0/2602571108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1006db10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fca10073470 tx=0x7fca0802a730 comp rx=0 tx=0).stop 2024-05-14T15:21:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 -- 172.21.15.2:0/2602571108 shutdown_connections 2024-05-14T15:21:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 --2- 172.21.15.2:0/2602571108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1006db10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 --2- 172.21.15.2:0/2602571108 >> v2:172.21.15.156:3300/0 conn(0x7fca100706e0 0x7fca10160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 -- 172.21.15.2:0/2602571108 >> 172.21.15.2:0/2602571108 conn(0x7fca100d1d10 msgr2=0x7fca100734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 -- 172.21.15.2:0/2602571108 shutdown_connections 2024-05-14T15:21:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.272+0000 7fca17800640 1 -- 172.21.15.2:0/2602571108 wait complete. 2024-05-14T15:21:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.275+0000 7fca17800640 1 Processor -- start 2024-05-14T15:21:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.275+0000 7fca17800640 1 -- start start 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca17800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca17800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca100706e0 0x7fca101521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca17800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca100b4690 0x7fca100b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca17800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca10164a30 con 0x7fca1006d700 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca17800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fca100b4aa0 con 0x7fca100706e0 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca17800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fca10164bb0 con 0x7fca100b4690 2024-05-14T15:21:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca14e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca14e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57640/0 (socket says 172.21.15.2:57640) 2024-05-14T15:21:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.277+0000 7fca14e00640 1 -- 172.21.15.2:0/3980602541 learned_addr learned my addr 172.21.15.2:0/3980602541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca14e00640 1 -- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca100b4690 msgr2=0x7fca100b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca14e00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca100b4690 0x7fca100b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca0fe00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca100706e0 0x7fca101521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca14e00640 1 -- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca100706e0 msgr2=0x7fca101521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca14e00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca100706e0 0x7fca101521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca14e00640 1 -- 172.21.15.2:0/3980602541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1015c340 con 0x7fca1006d700 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca0fe00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca100706e0 0x7fca101521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca14e00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1015be00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d620 tx=0x7fca0400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0400b620 con 0x7fca1006d700 2024-05-14T15:21:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca04019070 con 0x7fca1006d700 2024-05-14T15:21:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0400ba00 con 0x7fca1006d700 2024-05-14T15:21:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca100cfa40 con 0x7fca1006d700 2024-05-14T15:21:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.278+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca100d0000 con 0x7fca1006d700 2024-05-14T15:21:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.280+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca10050870 con 0x7fca1006d700 2024-05-14T15:21:18.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.281+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca0400bba0 con 0x7fca1006d700 2024-05-14T15:21:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.282+0000 7fca0cc00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9f0076300 0x7fc9f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.282+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7fca04097c50 con 0x7fca1006d700 2024-05-14T15:21:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.283+0000 7fca0fe00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9f0076300 0x7fc9f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.284+0000 7fca0fe00640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9f0076300 0x7fc9f0078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca1015c730 tx=0x7fc9fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.287+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca04061380 con 0x7fca1006d700 2024-05-14T15:21:18.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.542+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca100b0220 con 0x7fca1006d700 2024-05-14T15:21:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.543+0000 7fca0cc00640 1 -- 172.21.15.2:0/3980602541 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7fca04060c80 con 0x7fca1006d700 2024-05-14T15:21:18.543 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:18.543 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:17:08.156565+0000","modified":"2024-05-14T15:17:11.317343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.2:6835/3645921439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3645921439},{"type":"v1","addr":"172.21.15.2:6835","nonce":3645921439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4947,"qdb_cluster":[4947]},"id":2}]} 2024-05-14T15:21:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-05-14T15:21:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9f0076300 msgr2=0x7fc9f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9f0076300 0x7fc9f0078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca1015c730 tx=0x7fc9fc009040 comp rx=0 tx=0).stop 2024-05-14T15:21:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 msgr2=0x7fca1015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1015be00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d620 tx=0x7fca0400dae0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 shutdown_connections 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc9f0076300 0x7fc9f0078810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca100706e0 0x7fca101521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca100b4690 0x7fca100b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 --2- 172.21.15.2:0/3980602541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca1006d700 0x7fca1015be00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 >> 172.21.15.2:0/3980602541 conn(0x7fca100d1d10 msgr2=0x7fca100b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 shutdown_connections 2024-05-14T15:21:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.546+0000 7fca17800640 1 -- 172.21.15.2:0/3980602541 wait complete. 2024-05-14T15:21:18.575 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:21:18.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.855+0000 7fd9f0c00640 1 Processor -- start 2024-05-14T15:21:18.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.855+0000 7fd9f0c00640 1 -- start start 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.857+0000 7fd9f0c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9ec0b4dc0 0x7fd9ec0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.857+0000 7fd9f0c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec06db50 0x7fd9ec0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.857+0000 7fd9f0c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ec0d48d0 con 0x7fd9ec163bb0 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.857+0000 7fd9f0c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ec0d4bb0 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.857+0000 7fd9f0c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec0d4e90 con 0x7fd9ec06db50 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.858+0000 7fd9eb400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9ec0b4dc0 0x7fd9ec0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.858+0000 7fd9ebe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec06db50 0x7fd9ec0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.858+0000 7fd9eb400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9ec0b4dc0 0x7fd9ec0d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:52556/0 (socket says 172.21.15.2:52556) 2024-05-14T15:21:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.858+0000 7fd9eb400640 1 -- 172.21.15.2:0/825628966 learned_addr learned my addr 172.21.15.2:0/825628966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.859+0000 7fd9eb400640 1 -- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec06db50 msgr2=0x7fd9ec0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.859+0000 7fd9eb400640 1 --2- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec06db50 0x7fd9ec0d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.859+0000 7fd9eb400640 1 -- 172.21.15.2:0/825628966 >> v1:172.21.15.156:6789/0 conn(0x7fd9ec163bb0 legacy=0x7fd9ec160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.859+0000 7fd9eb400640 1 -- 172.21.15.2:0/825628966 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec0d5170 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.859+0000 7fd9ebe00640 1 --2- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec06db50 0x7fd9ec0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:21:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.860+0000 7fd9eb400640 1 --2- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec0d0770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009870 tx=0x7fd9d402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f13c76dfaf7841 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.860+0000 7fd9ea000640 1 -- 172.21.15.2:0/825628966 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4037070 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.860+0000 7fd9ea000640 1 -- 172.21.15.2:0/825628966 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d4032440 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.860+0000 7fd9ea000640 1 -- 172.21.15.2:0/825628966 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4032810 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 -- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec0b4dc0 msgr2=0x7fd9ec0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec0d0770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009870 tx=0x7fd9d402a250 comp rx=0 tx=0).stop 2024-05-14T15:21:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 -- 172.21.15.2:0/825628966 shutdown_connections 2024-05-14T15:21:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec06db50 0x7fd9ec0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/825628966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec0d0770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 -- 172.21.15.2:0/825628966 >> 172.21.15.2:0/825628966 conn(0x7fd9ec0b7600 msgr2=0x7fd9ec0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 -- 172.21.15.2:0/825628966 shutdown_connections 2024-05-14T15:21:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.861+0000 7fd9f0c00640 1 -- 172.21.15.2:0/825628966 wait complete. 2024-05-14T15:21:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.864+0000 7fd9f0c00640 1 Processor -- start 2024-05-14T15:21:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.864+0000 7fd9f0c00640 1 -- start start 2024-05-14T15:21:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.865+0000 7fd9f0c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec06db50 0x7fd9ec155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.865+0000 7fd9f0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.865+0000 7fd9f0c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec163bb0 0x7fd9ec1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.865+0000 7fd9f0c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec0d4490 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.865+0000 7fd9f0c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec0d4310 con 0x7fd9ec06db50 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.865+0000 7fd9f0c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec0d4610 con 0x7fd9ec163bb0 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec1584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57644/0 (socket says 172.21.15.2:57644) 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 -- 172.21.15.2:0/145028673 learned_addr learned my addr 172.21.15.2:0/145028673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eb400640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec06db50 0x7fd9ec155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9ebe00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec163bb0 0x7fd9ec1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 -- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec163bb0 msgr2=0x7fd9ec1f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec163bb0 0x7fd9ec1f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 -- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec06db50 msgr2=0x7fd9ec155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec06db50 0x7fd9ec155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.866+0000 7fd9eaa00640 1 -- 172.21.15.2:0/145028673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec157410 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.867+0000 7fd9eaa00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec1584b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00c370 tx=0x7fd9dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.867+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc017070 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.867+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0052d0 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.867+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc003830 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.867+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ec1576f0 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.867+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ec157cb0 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.868+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ec155d50 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.869+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd9dc01a070 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.870+0000 7fd9e3400640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd9c80762d0 0x7fd9c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.870+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7fd9dc096c10 con 0x7fd9ec0b4dc0 2024-05-14T15:21:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.871+0000 7fd9eb400640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd9c80762d0 0x7fd9c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.872+0000 7fd9eb400640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd9c80762d0 0x7fd9c80787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4034000 tx=0x7fd9d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:18.876+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd9dc0602c0 con 0x7fd9ec0b4dc0 2024-05-14T15:21:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.089+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9ec050870 con 0x7fd9ec0b4dc0 2024-05-14T15:21:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.091+0000 7fd9e3400640 1 -- 172.21.15.2:0/145028673 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17106 (secure 0 0 0) 0x7fd9dc068340 con 0x7fd9ec0b4dc0 2024-05-14T15:21:19.092 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:19.092 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:17:30.988656+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:17:05.637911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T15:17:07.143749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2","mappings":[{"from":4,"to":7}]},{"pgid":"6.11","mappings":[{"from":1,"to":7}]},{"pgid":"6.26","mappings":[{"from":4,"to":5}]},{"pgid":"6.29","mappings":[{"from":3,"to":2}]},{"pgid":"6.38","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.094+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd9c80762d0 msgr2=0x7fd9c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.094+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd9c80762d0 0x7fd9c80787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4034000 tx=0x7fd9d402e000 comp rx=0 tx=0).stop 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 msgr2=0x7fd9ec1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec1584b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00c370 tx=0x7fd9dc00c830 comp rx=0 tx=0).stop 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 shutdown_connections 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fd9c80762d0 0x7fd9c80787e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9ec163bb0 0x7fd9ec1f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9ec0b4dc0 0x7fd9ec1584b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 --2- 172.21.15.2:0/145028673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9ec06db50 0x7fd9ec155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 >> 172.21.15.2:0/145028673 conn(0x7fd9ec0b7600 msgr2=0x7fd9ec0b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:19.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 shutdown_connections 2024-05-14T15:21:19.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.095+0000 7fd9f0c00640 1 -- 172.21.15.2:0/145028673 wait complete. 2024-05-14T15:21:19.124 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T15:21:19.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:21:19.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.412+0000 7f5ff3200640 1 Processor -- start 2024-05-14T15:21:19.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.412+0000 7f5ff3200640 1 -- start start 2024-05-14T15:21:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.415+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 0x7f5fec0d4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.415+0000 7f5ff3200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fec1646c0 con 0x7f5fec164070 2024-05-14T15:21:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.415+0000 7f5ff3200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fec1649a0 con 0x7f5fec0d0870 2024-05-14T15:21:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.415+0000 7f5ff3200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5fec164480 con 0x7f5fec06dc80 2024-05-14T15:21:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.415+0000 7f5febe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5fec164070 0x7f5fec0d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46570/0 (socket says 172.21.15.2:46570) 2024-05-14T15:21:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.415+0000 7f5febe00640 1 -- 172.21.15.2:0/898018410 learned_addr learned my addr 172.21.15.2:0/898018410 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5ff1200640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 0x7f5fec0d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011435910 0 0) 0x7f5fec1646c0 con 0x7f5fec164070 2024-05-14T15:21:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd0003520 con 0x7f5fec164070 2024-05-14T15:21:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656208565 0 0) 0x7f5fd0003520 con 0x7f5fec164070 2024-05-14T15:21:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 msgr2=0x7f5fec0d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 0x7f5fec0d4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 >> v1:172.21.15.156:6789/0 conn(0x7f5fec0d0870 legacy=0x7f5fec160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.416+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec164c80 con 0x7f5fec164070 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f5fdc001a70 con 0x7f5fec164070 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 >> v1:172.21.15.2:6789/0 conn(0x7f5fec164070 legacy=0x7f5fec0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0003a30 0x7f5fd0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fd0004800 0x7f5fd0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 0x7f5fd00052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec164480 con 0x7f5fd0004800 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd000bb80 con 0x7f5fd0003a30 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd000bd80 con 0x7f5fec06dc80 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feb400640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fd0004800 0x7f5fd0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feb400640 1 -- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 msgr2=0x7f5fd00052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feb400640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec06dc80 0x7f5fd00052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feb400640 1 -- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0003a30 msgr2=0x7f5fd0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:19.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feb400640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0003a30 0x7f5fd0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.417+0000 7f5feb400640 1 -- 172.21.15.2:0/898018410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd0003520 con 0x7f5fd0004800 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.418+0000 7f5feb400640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fd0004800 0x7f5fd0004c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4001790 tx=0x7f5fd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef34a0961366f4dc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.419+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40013b0 con 0x7f5fd0004800 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.419+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd40052d0 con 0x7f5fd0004800 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.419+0000 7f5feaa00640 1 -- 172.21.15.2:0/898018410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd402aae0 con 0x7f5fd0004800 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.419+0000 7f5ff3200640 1 -- 172.21.15.2:0/898018410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fd0004800 msgr2=0x7f5fd0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.419+0000 7f5ff3200640 1 --2- 172.21.15.2:0/898018410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fd0004800 0x7f5fd0004c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4001790 tx=0x7f5fd0005830 comp rx=0 tx=0).stop 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.420+0000 7f5ff1200640 1 -- 172.21.15.2:0/898018410 reap_dead start 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.420+0000 7f5ff3200640 1 -- 172.21.15.2:0/898018410 shutdown_connections 2024-05-14T15:21:19.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.420+0000 7f5ff3200640 1 -- 172.21.15.2:0/898018410 >> 172.21.15.2:0/898018410 conn(0x7f5fec0d2770 msgr2=0x7f5fec0d2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.420+0000 7f5ff3200640 1 -- 172.21.15.2:0/898018410 shutdown_connections 2024-05-14T15:21:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.420+0000 7f5ff3200640 1 -- 172.21.15.2:0/898018410 wait complete. 2024-05-14T15:21:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.422+0000 7f5ff3200640 1 Processor -- start 2024-05-14T15:21:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.422+0000 7f5ff3200640 1 -- start start 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0004800 0x7f5fec15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec155150 0x7f5fec155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 0x7f5fec1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff3200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec0d4af0 con 0x7f5fec156ee0 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff3200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec0d4970 con 0x7f5fd0004800 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff3200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5fec0d4c70 con 0x7f5fec155150 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff1200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 0x7f5fec1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff1200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 0x7f5fec1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57664/0 (socket says 172.21.15.2:57664) 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.424+0000 7f5ff1200640 1 -- 172.21.15.2:0/3154800008 learned_addr learned my addr 172.21.15.2:0/3154800008 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5febe00640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0004800 0x7f5fec15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5feb400640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec155150 0x7f5fec155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5ff1200640 1 -- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec155150 msgr2=0x7f5fec155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5ff1200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec155150 0x7f5fec155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5ff1200640 1 -- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0004800 msgr2=0x7f5fec15ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5ff1200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0004800 0x7f5fec15ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5ff1200640 1 -- 172.21.15.2:0/3154800008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec15f380 con 0x7f5fec156ee0 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5feb400640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec155150 0x7f5fec155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.425+0000 7f5ff1200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 0x7f5fec1572f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5fec08df90 tx=0x7f5fe400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.426+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400c680 con 0x7f5fec156ee0 2024-05-14T15:21:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.426+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe401a070 con 0x7f5fec156ee0 2024-05-14T15:21:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.426+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec157d20 con 0x7f5fec156ee0 2024-05-14T15:21:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.426+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400ca60 con 0x7f5fec156ee0 2024-05-14T15:21:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.426+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec1582e0 con 0x7f5fec156ee0 2024-05-14T15:21:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.427+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fec050870 con 0x7f5fec156ee0 2024-05-14T15:21:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.428+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5fe400cc00 con 0x7f5fec156ee0 2024-05-14T15:21:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.429+0000 7f5fe3e00640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5fc80762d0 0x7f5fc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.430+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7f5fe40970d0 con 0x7f5fec156ee0 2024-05-14T15:21:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.430+0000 7f5febe00640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5fc80762d0 0x7f5fc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.432+0000 7f5febe00640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5fc80762d0 0x7f5fc80787e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0012e0 tx=0x7f5fdc001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.434+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5fe4023020 con 0x7f5fec156ee0 2024-05-14T15:21:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.688+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fec0d0ec0 con 0x7f5fec156ee0 2024-05-14T15:21:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.690+0000 7f5fe3e00640 1 -- 172.21.15.2:0/3154800008 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f5fe4060770 con 0x7f5fec156ee0 2024-05-14T15:21:19.690 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:19.690 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:17:08.156565+0000","modified":"2024-05-14T15:17:11.317343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.2:6835/3645921439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3645921439},{"type":"v1","addr":"172.21.15.2:6835","nonce":3645921439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4947,"qdb_cluster":[4947]},"id":2}]} 2024-05-14T15:21:19.690 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-05-14T15:21:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5fc80762d0 msgr2=0x7f5fc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5fc80762d0 0x7f5fc80787e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0012e0 tx=0x7f5fdc001ad0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 msgr2=0x7f5fec1572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 0x7f5fec1572f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5fec08df90 tx=0x7f5fe400ec00 comp rx=0 tx=0).stop 2024-05-14T15:21:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 shutdown_connections 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5fc80762d0 0x7f5fc80787e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fec156ee0 0x7f5fec1572f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fec155150 0x7f5fec155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 --2- 172.21.15.2:0/3154800008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fd0004800 0x7f5fec15ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 >> 172.21.15.2:0/3154800008 conn(0x7f5fec0d2770 msgr2=0x7f5fec15ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 shutdown_connections 2024-05-14T15:21:19.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:19.693+0000 7f5ff3200640 1 -- 172.21.15.2:0/3154800008 wait complete. 2024-05-14T15:21:19.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:21:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.008+0000 7f887a800640 1 Processor -- start 2024-05-14T15:21:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.008+0000 7f887a800640 1 -- start start 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.010+0000 7f887a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88740d1050 0x7f8874070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.010+0000 7f887a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f887406de10 0x7f88740ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.010+0000 7f887a800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88741618d0 con 0x7f8874070e80 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.010+0000 7f887a800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f88741624e0 con 0x7f88740d1050 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f887a800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f8874161bb0 con 0x7f887406de10 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88740d1050 0x7f8874070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88740d1050 0x7f8874070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54424/0 (socket says 172.21.15.2:54424) 2024-05-14T15:21:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 -- 172.21.15.2:0/548594060 learned_addr learned my addr 172.21.15.2:0/548594060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 -- 172.21.15.2:0/548594060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f887406de10 msgr2=0x7f88740ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 --2- 172.21.15.2:0/548594060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f887406de10 0x7f88740ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 -- 172.21.15.2:0/548594060 >> v1:172.21.15.156:6789/0 conn(0x7f8874070e80 legacy=0x7f887406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.011+0000 7f8879400640 1 -- 172.21.15.2:0/548594060 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8874161e90 con 0x7f88740d1050 2024-05-14T15:21:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.012+0000 7f8879400640 1 --2- 172.21.15.2:0/548594060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88740d1050 0x7f8874070940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8868009870 tx=0x7f886802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995f206d03198f5f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.013+0000 7f8873e00640 1 -- 172.21.15.2:0/548594060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868037070 con 0x7f88740d1050 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.013+0000 7f8873e00640 1 -- 172.21.15.2:0/548594060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8868032440 con 0x7f88740d1050 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.013+0000 7f8873e00640 1 -- 172.21.15.2:0/548594060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868032810 con 0x7f88740d1050 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 -- 172.21.15.2:0/548594060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88740d1050 msgr2=0x7f8874070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 --2- 172.21.15.2:0/548594060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88740d1050 0x7f8874070940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8868009870 tx=0x7f886802a1c0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 -- 172.21.15.2:0/548594060 shutdown_connections 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 --2- 172.21.15.2:0/548594060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f887406de10 0x7f88740ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 --2- 172.21.15.2:0/548594060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88740d1050 0x7f8874070940 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 -- 172.21.15.2:0/548594060 >> 172.21.15.2:0/548594060 conn(0x7f88740732e0 msgr2=0x7f88740736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 -- 172.21.15.2:0/548594060 shutdown_connections 2024-05-14T15:21:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.014+0000 7f887a800640 1 -- 172.21.15.2:0/548594060 wait complete. 2024-05-14T15:21:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.016+0000 7f887a800640 1 Processor -- start 2024-05-14T15:21:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.016+0000 7f887a800640 1 -- start start 2024-05-14T15:21:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f887a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 0x7f8874153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f887a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88740d1050 0x7f88740b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f887a800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8874152d50 0x7f887414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f887a800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f887415f290 con 0x7f8874070e80 2024-05-14T15:21:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f887a800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f887415f110 con 0x7f88740d1050 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f887a800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f88740aec90 con 0x7f8874152d50 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f8879400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 0x7f8874153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f8879400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 0x7f8874153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54436/0 (socket says 172.21.15.2:54436) 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.018+0000 7f8879400640 1 -- 172.21.15.2:0/1513924583 learned_addr learned my addr 172.21.15.2:0/1513924583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879400640 1 -- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8874152d50 msgr2=0x7f887414e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8878a00640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88740d1050 0x7f88740b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879e00640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8874152d50 0x7f887414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879400640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8874152d50 0x7f887414e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879400640 1 -- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88740d1050 msgr2=0x7f88740b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879400640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88740d1050 0x7f88740b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879400640 1 -- 172.21.15.2:0/1513924583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8874154110 con 0x7f8874070e80 2024-05-14T15:21:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8878a00640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88740d1050 0x7f88740b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:20.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879e00640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8874152d50 0x7f887414e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:20.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.019+0000 7f8879400640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 0x7f8874153950 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8868009870 tx=0x7f88680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.020+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868041070 con 0x7f8874070e80 2024-05-14T15:21:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.020+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886803c930 con 0x7f8874070e80 2024-05-14T15:21:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.020+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868037040 con 0x7f8874070e80 2024-05-14T15:21:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.020+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8874151f90 con 0x7f8874070e80 2024-05-14T15:21:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.020+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8874152550 con 0x7f8874070e80 2024-05-14T15:21:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.021+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8874050870 con 0x7f8874070e80 2024-05-14T15:21:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.023+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8868044070 con 0x7f8874070e80 2024-05-14T15:21:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.024+0000 7f8871600640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f88580762d0 0x7f88580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.024+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7f88680b8190 con 0x7f8874070e80 2024-05-14T15:21:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.025+0000 7f8878a00640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f88580762d0 0x7f88580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.026+0000 7f8878a00640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f88580762d0 0x7f88580787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f887409f9a0 tx=0x7f8864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.029+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f88680817b0 con 0x7f8874070e80 2024-05-14T15:21:20.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.283+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88740712f0 con 0x7f8874070e80 2024-05-14T15:21:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.285+0000 7f8871600640 1 -- 172.21.15.2:0/1513924583 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f88680810b0 con 0x7f8874070e80 2024-05-14T15:21:20.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:20.285 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:17:08.156565+0000","modified":"2024-05-14T15:17:11.317343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.2:6835/3645921439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3645921439},{"type":"v1","addr":"172.21.15.2:6835","nonce":3645921439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4947,"qdb_cluster":[4947]},"id":2}]} 2024-05-14T15:21:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.287+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f88580762d0 msgr2=0x7f88580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.287+0000 7f887a800640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f88580762d0 0x7f88580787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f887409f9a0 tx=0x7f8864008040 comp rx=0 tx=0).stop 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.287+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 msgr2=0x7f8874153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.287+0000 7f887a800640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 0x7f8874153950 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8868009870 tx=0x7f88680046c0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 shutdown_connections 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f88580762d0 0x7f88580787e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88740d1050 0x7f88740b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8874152d50 0x7f887414e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 --2- 172.21.15.2:0/1513924583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8874070e80 0x7f8874153950 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 >> 172.21.15.2:0/1513924583 conn(0x7f88740732e0 msgr2=0x7f88740af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 shutdown_connections 2024-05-14T15:21:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.288+0000 7f887a800640 1 -- 172.21.15.2:0/1513924583 wait complete. 2024-05-14T15:21:20.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:21:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.598+0000 7f498be00640 1 Processor -- start 2024-05-14T15:21:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.598+0000 7f498be00640 1 -- start start 2024-05-14T15:21:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.600+0000 7f498be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 0x7f498c0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.600+0000 7f498be00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f498c163bb0 0x7f498c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.600+0000 7f498be00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498c0d48d0 con 0x7f498c0d4310 2024-05-14T15:21:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.600+0000 7f498be00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f498c0d4bb0 con 0x7f498c163bb0 2024-05-14T15:21:20.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.600+0000 7f498be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f498c0d4e90 con 0x7f498c0b4dc0 2024-05-14T15:21:20.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.601+0000 7f498aa00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 0x7f498c0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.601+0000 7f498a000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f498c163bb0 0x7f498c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.601+0000 7f498aa00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 0x7f498c0d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.2:43012/0 (socket says 172.21.15.2:43012) 2024-05-14T15:21:20.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.601+0000 7f498aa00640 1 -- 172.21.15.2:0/1117015850 learned_addr learned my addr 172.21.15.2:0/1117015850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:20.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.602+0000 7f498aa00640 1 -- 172.21.15.2:0/1117015850 >> v2:172.21.15.156:3300/0 conn(0x7f498c163bb0 msgr2=0x7f498c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:20.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.602+0000 7f498aa00640 1 --2- 172.21.15.2:0/1117015850 >> v2:172.21.15.156:3300/0 conn(0x7f498c163bb0 0x7f498c0d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.602+0000 7f498aa00640 1 -- 172.21.15.2:0/1117015850 >> v1:172.21.15.156:6789/0 conn(0x7f498c0d4310 legacy=0x7f498c160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.602+0000 7f498aa00640 1 -- 172.21.15.2:0/1117015850 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498c0d5170 con 0x7f498c0b4dc0 2024-05-14T15:21:20.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.603+0000 7f498aa00640 1 --2- 172.21.15.2:0/1117015850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 0x7f498c0d0770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f497c009e50 tx=0x7f497c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=502863b356b30535 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:20.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.604+0000 7f4989600640 1 -- 172.21.15.2:0/1117015850 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c036070 con 0x7f498c0b4dc0 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.604+0000 7f4989600640 1 -- 172.21.15.2:0/1117015850 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c031600 con 0x7f498c0b4dc0 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.604+0000 7f4989600640 1 -- 172.21.15.2:0/1117015850 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0319d0 con 0x7f498c0b4dc0 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 -- 172.21.15.2:0/1117015850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 msgr2=0x7f498c0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 --2- 172.21.15.2:0/1117015850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 0x7f498c0d0770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f497c009e50 tx=0x7f497c02a710 comp rx=0 tx=0).stop 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 -- 172.21.15.2:0/1117015850 shutdown_connections 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 --2- 172.21.15.2:0/1117015850 >> v2:172.21.15.156:3300/0 conn(0x7f498c163bb0 0x7f498c0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 --2- 172.21.15.2:0/1117015850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0b4dc0 0x7f498c0d0770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 -- 172.21.15.2:0/1117015850 >> 172.21.15.2:0/1117015850 conn(0x7f498c0b7600 msgr2=0x7f498c0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 -- 172.21.15.2:0/1117015850 shutdown_connections 2024-05-14T15:21:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.605+0000 7f498be00640 1 -- 172.21.15.2:0/1117015850 wait complete. 2024-05-14T15:21:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.607+0000 7f498be00640 1 Processor -- start 2024-05-14T15:21:20.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.608+0000 7f498be00640 1 -- start start 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 0x7f498c15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498be00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0d4310 0x7f498c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f498c163bb0 0x7f498c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f498c06dcd0 con 0x7f498c0b4dc0 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f498c06db50 con 0x7f498c163bb0 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498be00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f498c06de50 con 0x7f498c0d4310 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 0x7f498c15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 0x7f498c15d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54440/0 (socket says 172.21.15.2:54440) 2024-05-14T15:21:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.609+0000 7f498aa00640 1 -- 172.21.15.2:0/1508772570 learned_addr learned my addr 172.21.15.2:0/1508772570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498a000640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0d4310 0x7f498c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498b400640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f498c163bb0 0x7f498c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498aa00640 1 -- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0d4310 msgr2=0x7f498c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498aa00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0d4310 0x7f498c0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498aa00640 1 -- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f498c163bb0 msgr2=0x7f498c0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498aa00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f498c163bb0 0x7f498c0cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498aa00640 1 -- 172.21.15.2:0/1508772570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498c15de20 con 0x7f498c0b4dc0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.610+0000 7f498aa00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 0x7f498c15d470 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f497c034040 tx=0x7f497c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.611+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c03f020 con 0x7f498c0b4dc0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.611+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c037040 con 0x7f498c0b4dc0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.611+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c036070 con 0x7f498c0b4dc0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.611+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498c0cca60 con 0x7f498c0b4dc0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.611+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f498c0ac6b0 con 0x7f498c0b4dc0 2024-05-14T15:21:20.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.612+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f498c050870 con 0x7f498c0b4dc0 2024-05-14T15:21:20.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.613+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f497c042020 con 0x7f498c0b4dc0 2024-05-14T15:21:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.614+0000 7f4982a00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4968076300 0x7f4968078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:20.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.614+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7f497c0b7d50 con 0x7f498c0b4dc0 2024-05-14T15:21:20.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.615+0000 7f498a000640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4968076300 0x7f4968078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:20.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.616+0000 7f498a000640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4968076300 0x7f4968078810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f498c1f9610 tx=0x7f4974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:20.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.619+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f497c049030 con 0x7f498c0b4dc0 2024-05-14T15:21:20.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.829+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f498c0d3da0 con 0x7f498c0b4dc0 2024-05-14T15:21:20.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.833+0000 7f4982a00640 1 -- 172.21.15.2:0/1508772570 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17106 (secure 0 0 0) 0x7f497c0813f0 con 0x7f498c0b4dc0 2024-05-14T15:21:20.833 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:20.833 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:17:30.988656+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:17:05.637911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T15:17:07.143749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2","mappings":[{"from":4,"to":7}]},{"pgid":"6.11","mappings":[{"from":1,"to":7}]},{"pgid":"6.26","mappings":[{"from":4,"to":5}]},{"pgid":"6.29","mappings":[{"from":3,"to":2}]},{"pgid":"6.38","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.835+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4968076300 msgr2=0x7f4968078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.835+0000 7f498be00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4968076300 0x7f4968078810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f498c1f9610 tx=0x7f4974008040 comp rx=0 tx=0).stop 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.835+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 msgr2=0x7f498c15d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.835+0000 7f498be00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 0x7f498c15d470 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f497c034040 tx=0x7f497c004a40 comp rx=0 tx=0).stop 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 shutdown_connections 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4968076300 0x7f4968078810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f498c163bb0 0x7f498c0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f498c0d4310 0x7f498c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 --2- 172.21.15.2:0/1508772570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f498c0b4dc0 0x7f498c15d470 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 >> 172.21.15.2:0/1508772570 conn(0x7f498c0b7600 msgr2=0x7f498c068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:20.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 shutdown_connections 2024-05-14T15:21:20.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:20.836+0000 7f498be00640 1 -- 172.21.15.2:0/1508772570 wait complete. 2024-05-14T15:21:20.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-14T15:21:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.139+0000 7f72af200640 1 Processor -- start 2024-05-14T15:21:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.139+0000 7f72af200640 1 -- start start 2024-05-14T15:21:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.141+0000 7f72af200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72b0160210 0x7f72b00d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.141+0000 7f72af200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b006c820 con 0x7f72b00d0910 2024-05-14T15:21:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.141+0000 7f72af200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b006cb00 con 0x7f72b00d4f10 2024-05-14T15:21:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.141+0000 7f72af200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00b4ed0 con 0x7f72b0160210 2024-05-14T15:21:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.141+0000 7f72ae800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f72b00d0910 0x7f72b00d0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55096/0 (socket says 172.21.15.2:55096) 2024-05-14T15:21:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.141+0000 7f72ae800640 1 -- 172.21.15.2:0/1783839758 learned_addr learned my addr 172.21.15.2:0/1783839758 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72ade00640 1 --2- 172.21.15.2:0/1783839758 >> v2:172.21.15.156:3300/0 conn(0x7f72b0160210 0x7f72b00d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529434377 0 0) 0x7f72b006c820 con 0x7f72b00d0910 2024-05-14T15:21:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7294003520 con 0x7f72b00d0910 2024-05-14T15:21:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879908945 0 0) 0x7f7294003520 con 0x7f72b00d0910 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 >> v2:172.21.15.156:3300/0 conn(0x7f72b0160210 msgr2=0x7f72b00d3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 --2- 172.21.15.2:0/1783839758 >> v2:172.21.15.156:3300/0 conn(0x7f72b0160210 0x7f72b00d3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 >> v1:172.21.15.156:6789/0 conn(0x7f72b00d4f10 legacy=0x7f72b00b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b006cde0 con 0x7f72b00d0910 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f72a8001a70 con 0x7f72b00d0910 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 >> v1:172.21.15.2:6789/0 conn(0x7f72b00d0910 legacy=0x7f72b00d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7294003a00 0x7f7294003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294004800 0x7f7294004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294005330 0x7f729400b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00b4ed0 con 0x7f7294004800 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f729400c2c0 con 0x7f7294005330 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.142+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f729400c4c0 con 0x7f7294003a00 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ad400640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294004800 0x7f7294004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ade00640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7294003a00 0x7f7294003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ae800640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294005330 0x7f729400b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ad400640 1 -- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7294003a00 msgr2=0x7f7294003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ad400640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7294003a00 0x7f7294003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ad400640 1 -- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294005330 msgr2=0x7f729400b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ad400640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294005330 0x7f729400b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ad400640 1 -- 172.21.15.2:0/1783839758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7294003520 con 0x7f7294004800 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ae800640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294005330 0x7f729400b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.143+0000 7f72ae800640 1 -- 172.21.15.2:0/1783839758 reap_dead start 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.144+0000 7f72ad400640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294004800 0x7f7294004c10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f729c003db0 tx=0x7f7294005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1b52fea55f3cc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.144+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c037070 con 0x7f7294004800 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.144+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c02a9f0 con 0x7f7294004800 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.144+0000 7f72aca00640 1 -- 172.21.15.2:0/1783839758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c003980 con 0x7f7294004800 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 -- 172.21.15.2:0/1783839758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294004800 msgr2=0x7f7294004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294004800 0x7f7294004c10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f729c003db0 tx=0x7f7294005830 comp rx=0 tx=0).stop 2024-05-14T15:21:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 -- 172.21.15.2:0/1783839758 shutdown_connections 2024-05-14T15:21:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 --2- 172.21.15.2:0/1783839758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294004800 0x7f7294004c10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 -- 172.21.15.2:0/1783839758 >> 172.21.15.2:0/1783839758 conn(0x7f72b00d6050 msgr2=0x7f72b00d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 -- 172.21.15.2:0/1783839758 shutdown_connections 2024-05-14T15:21:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.145+0000 7f72af200640 1 -- 172.21.15.2:0/1783839758 wait complete. 2024-05-14T15:21:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.147+0000 7f72af200640 1 Processor -- start 2024-05-14T15:21:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.148+0000 7f72af200640 1 -- start start 2024-05-14T15:21:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72af200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294004800 0x7f72b00ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72af200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b00cfcf0 0x7f72b0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72af200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 0x7f72b00ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72af200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d3ca0 con 0x7f72b00ac340 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72af200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d54d0 con 0x7f7294004800 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72af200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f72b00d3e20 con 0x7f72b00cfcf0 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72ae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 0x7f72b00ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72ae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 0x7f72b00ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54462/0 (socket says 172.21.15.2:54462) 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.149+0000 7f72ae800640 1 -- 172.21.15.2:0/1142132489 learned_addr learned my addr 172.21.15.2:0/1142132489 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72ae800640 1 -- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b00cfcf0 msgr2=0x7f72b0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72ae800640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b00cfcf0 0x7f72b0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72ae800640 1 -- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294004800 msgr2=0x7f72b00ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72ae800640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294004800 0x7f72b00ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72ae800640 1 -- 172.21.15.2:0/1142132489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00ad010 con 0x7f72b00ac340 2024-05-14T15:21:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72ae800640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 0x7f72b00ac750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000f80 tx=0x7f72a800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800de90 con 0x7f72b00ac340 2024-05-14T15:21:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a800bb20 con 0x7f72b00ac340 2024-05-14T15:21:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007070 con 0x7f72b00ac340 2024-05-14T15:21:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.150+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b00aef50 con 0x7f72b00ac340 2024-05-14T15:21:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.151+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b00aec70 con 0x7f72b00ac340 2024-05-14T15:21:21.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.152+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b00ae9e0 con 0x7f72b00ac340 2024-05-14T15:21:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.153+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f72a801b020 con 0x7f72b00ac340 2024-05-14T15:21:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.154+0000 7f72a6000640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7290076470 0x7f7290078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.154+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6246+0+0 (secure 0 0 0) 0x7f72a8097ad0 con 0x7f72b00ac340 2024-05-14T15:21:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.155+0000 7f72ade00640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7290076470 0x7f7290078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.156+0000 7f72ade00640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7290076470 0x7f7290078980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72a0006a90 tx=0x7f72a0006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.158+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f72a8061170 con 0x7f72b00ac340 2024-05-14T15:21:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.407+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f72b0050870 con 0x7f72b00ac340 2024-05-14T15:21:21.408 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-05-14T15:21:21.408+0000 7f9500200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T15:21:21.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.412+0000 7f72a6000640 1 -- 172.21.15.2:0/1142132489 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f72a8060a70 con 0x7f72b00ac340 2024-05-14T15:21:21.412 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T15:21:21.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.414+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7290076470 msgr2=0x7f7290078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.414+0000 7f72af200640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7290076470 0x7f7290078980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72a0006a90 tx=0x7f72a0006a20 comp rx=0 tx=0).stop 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.414+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 msgr2=0x7f72b00ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.414+0000 7f72af200640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 0x7f72b00ac750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000f80 tx=0x7f72a800b4a0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 shutdown_connections 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f7290076470 0x7f7290078980 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72b00ac340 0x7f72b00ac750 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b00cfcf0 0x7f72b0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 --2- 172.21.15.2:0/1142132489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7294004800 0x7f72b00ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 >> 172.21.15.2:0/1142132489 conn(0x7f72b00d6050 msgr2=0x7f72b00d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:21.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 shutdown_connections 2024-05-14T15:21:21.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.415+0000 7f72af200640 1 -- 172.21.15.2:0/1142132489 wait complete. 2024-05-14T15:21:21.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T15:21:21.594 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-05-14T15:21:21.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.698+0000 7ffaffe00640 1 Processor -- start 2024-05-14T15:21:21.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.698+0000 7ffaffe00640 1 -- start start 2024-05-14T15:21:21.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffaffe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb0015db90 0x7ffb000d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffaffe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb00164120 0x7ffb000b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffaffe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb000d4810 con 0x7ffb000d0ee0 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffaffe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ffb000d4af0 con 0x7ffb0015db90 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffaffe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7ffb000d4dd0 con 0x7ffb00164120 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffafea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb0015db90 0x7ffb000d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffafea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb0015db90 0x7ffb000d41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54486/0 (socket says 172.21.15.2:54486) 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffafea00640 1 -- 172.21.15.2:0/197097350 learned_addr learned my addr 172.21.15.2:0/197097350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.700+0000 7ffaf6000640 1 --1- 172.21.15.2:0/197097350 >> v1:172.21.15.2:6789/0 conn(0x7ffb000d0ee0 0x7ffb00163a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55108/0 (socket says 172.21.15.2:55108) 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.701+0000 7ffaff400640 1 --2- 172.21.15.2:0/197097350 >> v2:172.21.15.156:3300/0 conn(0x7ffb00164120 0x7ffb000b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.701+0000 7ffafea00640 1 -- 172.21.15.2:0/197097350 >> v2:172.21.15.156:3300/0 conn(0x7ffb00164120 msgr2=0x7ffb000b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.701+0000 7ffafea00640 1 --2- 172.21.15.2:0/197097350 >> v2:172.21.15.156:3300/0 conn(0x7ffb00164120 0x7ffb000b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.701+0000 7ffafea00640 1 -- 172.21.15.2:0/197097350 >> v1:172.21.15.2:6789/0 conn(0x7ffb000d0ee0 legacy=0x7ffb00163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.701+0000 7ffafea00640 1 -- 172.21.15.2:0/197097350 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb000d50b0 con 0x7ffb0015db90 2024-05-14T15:21:21.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.703+0000 7ffafea00640 1 --2- 172.21.15.2:0/197097350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb0015db90 0x7ffb000d41a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb000d68a0 tx=0x7ffaf002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e82bb4ad7c0389 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.703+0000 7ffafe000640 1 -- 172.21.15.2:0/197097350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0037070 con 0x7ffb0015db90 2024-05-14T15:21:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.703+0000 7ffafe000640 1 -- 172.21.15.2:0/197097350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0032440 con 0x7ffb0015db90 2024-05-14T15:21:21.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.703+0000 7ffafe000640 1 -- 172.21.15.2:0/197097350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0032810 con 0x7ffb0015db90 2024-05-14T15:21:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.704+0000 7ffaffe00640 1 -- 172.21.15.2:0/197097350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb0015db90 msgr2=0x7ffb000d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.704+0000 7ffaffe00640 1 --2- 172.21.15.2:0/197097350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb0015db90 0x7ffb000d41a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb000d68a0 tx=0x7ffaf002a1f0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.704+0000 7ffaffe00640 1 -- 172.21.15.2:0/197097350 shutdown_connections 2024-05-14T15:21:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.704+0000 7ffaffe00640 1 --2- 172.21.15.2:0/197097350 >> v2:172.21.15.156:3300/0 conn(0x7ffb00164120 0x7ffb000b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.704+0000 7ffaffe00640 1 --2- 172.21.15.2:0/197097350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb0015db90 0x7ffb000d41a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.704+0000 7ffaffe00640 1 -- 172.21.15.2:0/197097350 >> 172.21.15.2:0/197097350 conn(0x7ffb000d6040 msgr2=0x7ffb000b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.705+0000 7ffaffe00640 1 -- 172.21.15.2:0/197097350 shutdown_connections 2024-05-14T15:21:21.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.705+0000 7ffaffe00640 1 -- 172.21.15.2:0/197097350 wait complete. 2024-05-14T15:21:21.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.708+0000 7ffaffe00640 1 Processor -- start 2024-05-14T15:21:21.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.708+0000 7ffaffe00640 1 -- start start 2024-05-14T15:21:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaffe00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb000d0ee0 0x7ffb000ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb0015db90 0x7ffb000c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaffe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 0x7ffb0006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaffe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb000b4a00 con 0x7ffb000c9980 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaffe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ffb000d1500 con 0x7ffb0015db90 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaffe00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7ffb000b4b80 con 0x7ffb000d0ee0 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaff400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 0x7ffb0006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaff400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 0x7ffb0006e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54496/0 (socket says 172.21.15.2:54496) 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaff400640 1 -- 172.21.15.2:0/299201583 learned_addr learned my addr 172.21.15.2:0/299201583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffaf6000640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb0015db90 0x7ffb000c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.710+0000 7ffafea00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb000d0ee0 0x7ffb000ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaff400640 1 -- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb000d0ee0 msgr2=0x7ffb000ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaff400640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb000d0ee0 0x7ffb000ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaff400640 1 -- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb0015db90 msgr2=0x7ffb000c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaff400640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb0015db90 0x7ffb000c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:21.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaff400640 1 -- 172.21.15.2:0/299201583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb000ba290 con 0x7ffb000c9980 2024-05-14T15:21:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaff400640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 0x7ffb0006e8e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8007d40 tx=0x7ffaf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8014420 con 0x7ffb000c9980 2024-05-14T15:21:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8019070 con 0x7ffb000c9980 2024-05-14T15:21:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8014820 con 0x7ffb000c9980 2024-05-14T15:21:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb000ba570 con 0x7ffb000c9980 2024-05-14T15:21:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.711+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb000bab30 con 0x7ffb000c9980 2024-05-14T15:21:21.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.713+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb000ba000 con 0x7ffb000c9980 2024-05-14T15:21:21.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.714+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffaf80149c0 con 0x7ffb000c9980 2024-05-14T15:21:21.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.715+0000 7ffaf7400640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ffadc076300 0x7ffadc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:21.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.715+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6332+0+0 (secure 0 0 0) 0x7ffaf8098150 con 0x7ffb000c9980 2024-05-14T15:21:21.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.716+0000 7ffafea00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ffadc076300 0x7ffadc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.717+0000 7ffafea00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ffadc076300 0x7ffadc078810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0034000 tx=0x7ffaf002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:21.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.720+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffaf8061710 con 0x7ffb000c9980 2024-05-14T15:21:21.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:21.964+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffb00050870 con 0x7ffb000c9980 2024-05-14T15:21:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.415+0000 7ffaf7400640 1 -- 172.21.15.2:0/299201583 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7ffaf8061010 con 0x7ffb000c9980 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.418+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ffadc076300 msgr2=0x7ffadc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.418+0000 7ffaffe00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ffadc076300 0x7ffadc078810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0034000 tx=0x7ffaf002e000 comp rx=0 tx=0).stop 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 msgr2=0x7ffb0006e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 0x7ffb0006e8e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8007d40 tx=0x7ffaf800e4b0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 shutdown_connections 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7ffadc076300 0x7ffadc078810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb0015db90 0x7ffb000c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb000c9980 0x7ffb0006e8e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 --2- 172.21.15.2:0/299201583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb000d0ee0 0x7ffb000ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 >> 172.21.15.2:0/299201583 conn(0x7ffb000d6040 msgr2=0x7ffb0006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 shutdown_connections 2024-05-14T15:21:22.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.419+0000 7ffaffe00640 1 -- 172.21.15.2:0/299201583 wait complete. 2024-05-14T15:21:22.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T15:21:22.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.738+0000 7f0c3b600640 1 Processor -- start 2024-05-14T15:21:22.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.738+0000 7f0c3b600640 1 -- start start 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.739+0000 7f0c3b600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c3406f5d0 0x7f0c34163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c3b600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c341643e0 0x7f0c341647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c3b600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c3b600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f0c340b5210 con 0x7f0c341643e0 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c3b600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f0c340d2650 con 0x7f0c3406f5d0 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c3b600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f0c340d2930 con 0x7f0c340b19d0 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c33e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c341643e0 0x7f0c341647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c33e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c341643e0 0x7f0c341647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54498/0 (socket says 172.21.15.2:54498) 2024-05-14T15:21:22.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c33e00640 1 -- 172.21.15.2:0/1723896190 learned_addr learned my addr 172.21.15.2:0/1723896190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:22.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c38c00640 1 --2- 172.21.15.2:0/1723896190 >> v2:172.21.15.156:3300/0 conn(0x7f0c3406f5d0 0x7f0c34163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.740+0000 7f0c39600640 1 --2- 172.21.15.2:0/1723896190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.741+0000 7f0c33e00640 1 -- 172.21.15.2:0/1723896190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 msgr2=0x7f0c340b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.741+0000 7f0c33e00640 1 --2- 172.21.15.2:0/1723896190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.741+0000 7f0c33e00640 1 -- 172.21.15.2:0/1723896190 >> v2:172.21.15.156:3300/0 conn(0x7f0c3406f5d0 msgr2=0x7f0c34163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.741+0000 7f0c33e00640 1 --2- 172.21.15.2:0/1723896190 >> v2:172.21.15.156:3300/0 conn(0x7f0c3406f5d0 0x7f0c34163ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.741+0000 7f0c33e00640 1 -- 172.21.15.2:0/1723896190 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340d2c10 con 0x7f0c341643e0 2024-05-14T15:21:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.742+0000 7f0c33e00640 1 --2- 172.21.15.2:0/1723896190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c341643e0 0x7f0c341647f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c340b5440 tx=0x7f0c1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9666856ff0510a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.742+0000 7f0c33400640 1 -- 172.21.15.2:0/1723896190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c037070 con 0x7f0c341643e0 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.742+0000 7f0c33400640 1 -- 172.21.15.2:0/1723896190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c032440 con 0x7f0c341643e0 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.742+0000 7f0c33400640 1 -- 172.21.15.2:0/1723896190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c032810 con 0x7f0c341643e0 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 -- 172.21.15.2:0/1723896190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c341643e0 msgr2=0x7f0c341647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1723896190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c341643e0 0x7f0c341647f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c340b5440 tx=0x7f0c1c02a1e0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 -- 172.21.15.2:0/1723896190 shutdown_connections 2024-05-14T15:21:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1723896190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1723896190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c341643e0 0x7f0c341647f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1723896190 >> v2:172.21.15.156:3300/0 conn(0x7f0c3406f5d0 0x7f0c34163ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 -- 172.21.15.2:0/1723896190 >> 172.21.15.2:0/1723896190 conn(0x7f0c340b75c0 msgr2=0x7f0c340b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 -- 172.21.15.2:0/1723896190 shutdown_connections 2024-05-14T15:21:22.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.743+0000 7f0c3b600640 1 -- 172.21.15.2:0/1723896190 wait complete. 2024-05-14T15:21:22.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.745+0000 7f0c3b600640 1 Processor -- start 2024-05-14T15:21:22.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.746+0000 7f0c3b600640 1 -- start start 2024-05-14T15:21:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c3b600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 0x7f0c340c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c3b600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c3b600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c341643e0 0x7f0c341f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c3b600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34164d30 con 0x7f0c3406f5d0 2024-05-14T15:21:22.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c3b600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3406f9e0 con 0x7f0c341643e0 2024-05-14T15:21:22.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c3b600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f0c340b2320 con 0x7f0c340b19d0 2024-05-14T15:21:22.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c38c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 0x7f0c340c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c38c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 0x7f0c340c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54506/0 (socket says 172.21.15.2:54506) 2024-05-14T15:21:22.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.747+0000 7f0c38c00640 1 -- 172.21.15.2:0/1067869975 learned_addr learned my addr 172.21.15.2:0/1067869975 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c33e00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c38c00640 1 -- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 msgr2=0x7f0c340c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c38c00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c38c00640 1 -- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c341643e0 msgr2=0x7f0c341f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c38c00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c341643e0 0x7f0c341f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c38c00640 1 -- 172.21.15.2:0/1067869975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c34162ef0 con 0x7f0c3406f5d0 2024-05-14T15:21:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c38c00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 0x7f0c340c8870 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c24007e40 tx=0x7f0c2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.748+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24014620 con 0x7f0c3406f5d0 2024-05-14T15:21:22.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.749+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c24019070 con 0x7f0c3406f5d0 2024-05-14T15:21:22.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.749+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c34163190 con 0x7f0c3406f5d0 2024-05-14T15:21:22.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.749+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24014a00 con 0x7f0c3406f5d0 2024-05-14T15:21:22.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.749+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c34163710 con 0x7f0c3406f5d0 2024-05-14T15:21:22.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.750+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c34050870 con 0x7f0c3406f5d0 2024-05-14T15:21:22.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.751+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c24014ba0 con 0x7f0c3406f5d0 2024-05-14T15:21:22.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.753+0000 7f0c30c00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0c10076300 0x7f0c10078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.753+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6332+0+0 (secure 0 0 0) 0x7f0c24098220 con 0x7f0c3406f5d0 2024-05-14T15:21:22.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.754+0000 7f0c33e00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0c10076300 0x7f0c10078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.755+0000 7f0c33e00640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0c10076300 0x7f0c10078810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c034000 tx=0x7f0c1c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.758+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0c240617e0 con 0x7f0c3406f5d0 2024-05-14T15:21:22.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:22.968+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c340cf4e0 con 0x7f0c3406f5d0 2024-05-14T15:21:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.430+0000 7f0c30c00640 1 -- 172.21.15.2:0/1067869975 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) ==== 181+0+0 (secure 0 0 0) 0x7f0c240610e0 con 0x7f0c3406f5d0 2024-05-14T15:21:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-05-14T15:21:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.434+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0c10076300 msgr2=0x7f0c10078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.434+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0c10076300 0x7f0c10078810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c034000 tx=0x7f0c1c02e000 comp rx=0 tx=0).stop 2024-05-14T15:21:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.434+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 msgr2=0x7f0c340c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.434+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 0x7f0c340c8870 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c24007e40 tx=0x7f0c2400e4b0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.436+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 shutdown_connections 2024-05-14T15:21:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.436+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f0c10076300 0x7f0c10078810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.436+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c341643e0 0x7f0c341f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.436+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c340b19d0 0x7f0c340c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.436+0000 7f0c3b600640 1 --2- 172.21.15.2:0/1067869975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3406f5d0 0x7f0c340c8870 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.436+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 >> 172.21.15.2:0/1067869975 conn(0x7f0c340b75c0 msgr2=0x7f0c340d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:23.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.437+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 shutdown_connections 2024-05-14T15:21:23.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.437+0000 7f0c3b600640 1 -- 172.21.15.2:0/1067869975 wait complete. 2024-05-14T15:21:23.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T15:21:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.767+0000 7f0257000640 1 Processor -- start 2024-05-14T15:21:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.767+0000 7f0257000640 1 -- start start 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.769+0000 7f0257000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02501639e0 0x7f02500cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.769+0000 7f0257000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02500cf920 0x7f02500b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.769+0000 7f0257000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02500b6c30 con 0x7f02500d2d10 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.769+0000 7f0257000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f02500cdef0 con 0x7f02501639e0 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.769+0000 7f0257000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f02500cfd30 con 0x7f02500cf920 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02501639e0 0x7f02500cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02501639e0 0x7f02500cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54520/0 (socket says 172.21.15.2:54520) 2024-05-14T15:21:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 -- 172.21.15.2:0/1202737850 learned_addr learned my addr 172.21.15.2:0/1202737850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024f400640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02500cf920 0x7f02500b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 -- 172.21.15.2:0/1202737850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02500cf920 msgr2=0x7f02500b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02500cf920 0x7f02500b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 -- 172.21.15.2:0/1202737850 >> v1:172.21.15.156:6789/0 conn(0x7f02500d2d10 legacy=0x7f02500d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024fe00640 1 -- 172.21.15.2:0/1202737850 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02500cffc0 con 0x7f02501639e0 2024-05-14T15:21:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.770+0000 7f024f400640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02500cf920 0x7f02500b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:23.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.771+0000 7f024fe00640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02501639e0 0x7f02500cec20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0240009870 tx=0x7f024002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecb53fa52c0cd55 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:23.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.772+0000 7f024ea00640 1 -- 172.21.15.2:0/1202737850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240037070 con 0x7f02501639e0 2024-05-14T15:21:23.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.772+0000 7f024ea00640 1 -- 172.21.15.2:0/1202737850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0240032440 con 0x7f02501639e0 2024-05-14T15:21:23.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.772+0000 7f024ea00640 1 -- 172.21.15.2:0/1202737850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240032810 con 0x7f02501639e0 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 -- 172.21.15.2:0/1202737850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02501639e0 msgr2=0x7f02500cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02501639e0 0x7f02500cec20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0240009870 tx=0x7f024002a1c0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 -- 172.21.15.2:0/1202737850 shutdown_connections 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02500cf920 0x7f02500b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 --2- 172.21.15.2:0/1202737850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02501639e0 0x7f02500cec20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 -- 172.21.15.2:0/1202737850 >> 172.21.15.2:0/1202737850 conn(0x7f02500d0500 msgr2=0x7f02500d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 -- 172.21.15.2:0/1202737850 shutdown_connections 2024-05-14T15:21:23.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.773+0000 7f0257000640 1 -- 172.21.15.2:0/1202737850 wait complete. 2024-05-14T15:21:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.775+0000 7f0257000640 1 Processor -- start 2024-05-14T15:21:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.775+0000 7f0257000640 1 -- start start 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f0257000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02500cf920 0x7f025014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f0257000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 0x7f025014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f0257000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02501639e0 0x7f025014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f0257000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f02500ce700 con 0x7f02500d2d10 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f0257000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f02500ce420 con 0x7f02500cf920 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f0257000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f02500d1470 con 0x7f02501639e0 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f024f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 0x7f025014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f024f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 0x7f025014e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54530/0 (socket says 172.21.15.2:54530) 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.777+0000 7f024f400640 1 -- 172.21.15.2:0/1905644640 learned_addr learned my addr 172.21.15.2:0/1905644640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024fe00640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02500cf920 0x7f025014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f0255000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02501639e0 0x7f025014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024f400640 1 -- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02501639e0 msgr2=0x7f025014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024f400640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02501639e0 0x7f025014ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024f400640 1 -- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02500cf920 msgr2=0x7f025014d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024f400640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02500cf920 0x7f025014d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024f400640 1 -- 172.21.15.2:0/1905644640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025014f110 con 0x7f02500d2d10 2024-05-14T15:21:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024fe00640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02500cf920 0x7f025014d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.778+0000 7f024f400640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 0x7f025014e690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f023c00c7f0 tx=0x7f023c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.779+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c015070 con 0x7f02500d2d10 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.779+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023c007820 con 0x7f02500d2d10 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.779+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c007bd0 con 0x7f02500d2d10 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.779+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025014f3c0 con 0x7f02500d2d10 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.779+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025014f980 con 0x7f02500d2d10 2024-05-14T15:21:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.780+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0250050870 con 0x7f02500d2d10 2024-05-14T15:21:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.782+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f023c018070 con 0x7f02500d2d10 2024-05-14T15:21:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.783+0000 7f0247e00640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f02300762d0 0x7f02300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.783+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5894+0+0 (secure 0 0 0) 0x7f023c0978b0 con 0x7f02500d2d10 2024-05-14T15:21:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.783+0000 7f024fe00640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f02300762d0 0x7f02300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:23.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.785+0000 7f024fe00640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f02300762d0 0x7f02300787e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0240034000 tx=0x7f024002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.788+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f023c061020 con 0x7f02500d2d10 2024-05-14T15:21:23.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:23.999+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f02500b5a30 con 0x7f02500d2d10 2024-05-14T15:21:24.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.434+0000 7f0247e00640 1 -- 172.21.15.2:0/1905644640 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) ==== 169+0+0 (secure 0 0 0) 0x7f023c060920 con 0x7f02500d2d10 2024-05-14T15:21:24.434 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-05-14T15:21:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f02300762d0 msgr2=0x7f02300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f02300762d0 0x7f02300787e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0240034000 tx=0x7f024002e000 comp rx=0 tx=0).stop 2024-05-14T15:21:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 msgr2=0x7f025014e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 0x7f025014e690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f023c00c7f0 tx=0x7f023c00ccb0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 shutdown_connections 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f02300762d0 0x7f02300787e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02501639e0 0x7f025014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02500d2d10 0x7f025014e690 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 --2- 172.21.15.2:0/1905644640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02500cf920 0x7f025014d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.437+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 >> 172.21.15.2:0/1905644640 conn(0x7f02500d0500 msgr2=0x7f0250162bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.438+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 shutdown_connections 2024-05-14T15:21:24.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.438+0000 7f0257000640 1 -- 172.21.15.2:0/1905644640 wait complete. 2024-05-14T15:21:24.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-14T15:21:24.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.759+0000 7f9ed1800640 1 Processor -- start 2024-05-14T15:21:24.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.759+0000 7f9ed1800640 1 -- start start 2024-05-14T15:21:24.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.762+0000 7f9ed1800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc09bb20 0x7f9ecc160770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.762+0000 7f9ed1800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ecc161740 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.762+0000 7f9ed1800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ecc160ea0 con 0x7f9ecc0cfa20 2024-05-14T15:21:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.762+0000 7f9ed1800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f9ecc06d120 con 0x7f9ecc09bb20 2024-05-14T15:21:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.763+0000 7f9ecbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9ecc0b3ea0 0x7f9ecc09b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55112/0 (socket says 172.21.15.2:55112) 2024-05-14T15:21:24.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.763+0000 7f9ecbe00640 1 -- 172.21.15.2:0/949055992 learned_addr learned my addr 172.21.15.2:0/949055992 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.763+0000 7f9ecb400640 1 --2- 172.21.15.2:0/949055992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc09bb20 0x7f9ecc160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.763+0000 7f9ecaa00640 1 -- 172.21.15.2:0/949055992 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591249741 0 0) 0x7f9ecc161740 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.763+0000 7f9ecaa00640 1 -- 172.21.15.2:0/949055992 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eb0003520 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.764+0000 7f9ecaa00640 1 -- 172.21.15.2:0/949055992 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781934245 0 0) 0x7f9eb0003520 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.764+0000 7f9ecb400640 1 -- 172.21.15.2:0/949055992 >> v1:172.21.15.156:6789/0 conn(0x7f9ecc0cfa20 legacy=0x7f9ecc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.764+0000 7f9ecb400640 1 -- 172.21.15.2:0/949055992 >> v1:172.21.15.2:6789/0 conn(0x7f9ecc0b3ea0 legacy=0x7f9ecc09b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.764+0000 7f9ecb400640 1 -- 172.21.15.2:0/949055992 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc161180 con 0x7f9ecc09bb20 2024-05-14T15:21:24.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.765+0000 7f9ecb400640 1 --2- 172.21.15.2:0/949055992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc09bb20 0x7f9ecc160770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80097d0 tx=0x7f9eb802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7229e1206e79fd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.766+0000 7f9ecaa00640 1 -- 172.21.15.2:0/949055992 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8037070 con 0x7f9ecc09bb20 2024-05-14T15:21:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.766+0000 7f9ecaa00640 1 -- 172.21.15.2:0/949055992 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb802ac30 con 0x7f9ecc09bb20 2024-05-14T15:21:24.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.766+0000 7f9ecaa00640 1 -- 172.21.15.2:0/949055992 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0016f0 con 0x7f9ecc09bb20 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.766+0000 7f9ed1800640 1 -- 172.21.15.2:0/949055992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc09bb20 msgr2=0x7f9ecc160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.766+0000 7f9ed1800640 1 --2- 172.21.15.2:0/949055992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc09bb20 0x7f9ecc160770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80097d0 tx=0x7f9eb802a1a0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.767+0000 7f9ed1800640 1 -- 172.21.15.2:0/949055992 shutdown_connections 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.767+0000 7f9ed1800640 1 --2- 172.21.15.2:0/949055992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc09bb20 0x7f9ecc160770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.767+0000 7f9ed1800640 1 -- 172.21.15.2:0/949055992 >> 172.21.15.2:0/949055992 conn(0x7f9ecc0b74a0 msgr2=0x7f9ecc0b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.767+0000 7f9ed1800640 1 -- 172.21.15.2:0/949055992 shutdown_connections 2024-05-14T15:21:24.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.767+0000 7f9ed1800640 1 -- 172.21.15.2:0/949055992 wait complete. 2024-05-14T15:21:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.769+0000 7f9ed1800640 1 Processor -- start 2024-05-14T15:21:24.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.769+0000 7f9ed1800640 1 -- start start 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed1800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 0x7f9ecc14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed1800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ecc0cfa20 0x7f9ecc09e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed1800640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc071500 0x7f9ecc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed1800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc06dcc0 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed1800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc0cfe30 con 0x7f9ecc0cfa20 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed1800640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f9ecc06de40 con 0x7f9ecc071500 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 0x7f9ecc14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:24.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 0x7f9ecc14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54546/0 (socket says 172.21.15.2:54546) 2024-05-14T15:21:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ecbe00640 1 -- 172.21.15.2:0/2276834447 learned_addr learned my addr 172.21.15.2:0/2276834447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ed0e00640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc071500 0x7f9ecc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:24.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.771+0000 7f9ecb400640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ecc0cfa20 0x7f9ecc09e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ecbe00640 1 -- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc071500 msgr2=0x7f9ecc071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ecbe00640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc071500 0x7f9ecc071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ecbe00640 1 -- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ecc0cfa20 msgr2=0x7f9ecc09e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ecbe00640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ecc0cfa20 0x7f9ecc09e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ecbe00640 1 -- 172.21.15.2:0/2276834447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc071e50 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ecbe00640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 0x7f9ecc14b2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0013c0 tx=0x7f9ebc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc005ad0 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00ce50 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc007070 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc09eb50 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.772+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc09f340 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.774+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ecc06ec00 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.775+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ebc007210 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.776+0000 7f9ec3e00640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9eac076300 0x7f9eac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.776+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f9ebc097110 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.777+0000 7f9ecb400640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9eac076300 0x7f9eac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:24.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.778+0000 7f9ecb400640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9eac076300 0x7f9eac078810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8034000 tx=0x7f9eb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:24.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.781+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ecc06ec00 con 0x7f9ecc0b3ea0 2024-05-14T15:21:24.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:24.992+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9ecc050870 con 0x7f9ecc0b3ea0 2024-05-14T15:21:25.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.000+0000 7f9ec3e00640 1 -- 172.21.15.2:0/2276834447 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f9ecc071e50 con 0x7f9ecc0b3ea0 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9eac076300 msgr2=0x7f9eac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9eac076300 0x7f9eac078810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8034000 tx=0x7f9eb802e000 comp rx=0 tx=0).stop 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 msgr2=0x7f9ecc14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 0x7f9ecc14b2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0013c0 tx=0x7f9ebc00cb10 comp rx=0 tx=0).stop 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 shutdown_connections 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f9eac076300 0x7f9eac078810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ecc0cfa20 0x7f9ecc09e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ecc071500 0x7f9ecc071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 --2- 172.21.15.2:0/2276834447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ecc0b3ea0 0x7f9ecc14b2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.003+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 >> 172.21.15.2:0/2276834447 conn(0x7f9ecc0b74a0 msgr2=0x7f9ecc09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.004+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 shutdown_connections 2024-05-14T15:21:25.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.004+0000 7f9ed1800640 1 -- 172.21.15.2:0/2276834447 wait complete. 2024-05-14T15:21:25.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-05-14T15:21:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.312+0000 7f3cdf200640 1 Processor -- start 2024-05-14T15:21:25.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.312+0000 7f3cdf200640 1 -- start start 2024-05-14T15:21:25.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.314+0000 7f3cdf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce00b4dc0 0x7f3ce00d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.314+0000 7f3cdf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce00d48d0 con 0x7f3ce006db50 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.314+0000 7f3cdf200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce00d4bb0 con 0x7f3ce0163bb0 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.315+0000 7f3cdf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00d4e90 con 0x7f3ce00b4dc0 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.315+0000 7f3cde800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3ce006db50 0x7f3ce0160d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55120/0 (socket says 172.21.15.2:55120) 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.315+0000 7f3cde800640 1 -- 172.21.15.2:0/931528977 learned_addr learned my addr 172.21.15.2:0/931528977 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.315+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249532508 0 0) 0x7f3ce00d48d0 con 0x7f3ce006db50 2024-05-14T15:21:25.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.315+0000 7f3cdde00640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce00b4dc0 0x7f3ce00d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cc4003520 con 0x7f3ce006db50 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2042372484 0 0) 0x7f3cc4003520 con 0x7f3ce006db50 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce00b4dc0 msgr2=0x7f3ce00d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce00b4dc0 0x7f3ce00d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 >> v1:172.21.15.156:6789/0 conn(0x7f3ce0163bb0 legacy=0x7f3ce0160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce00d5170 con 0x7f3ce006db50 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f3cd8001a70 con 0x7f3ce006db50 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 >> v1:172.21.15.2:6789/0 conn(0x7f3ce006db50 legacy=0x7f3ce0160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4003a30 0x7f3cc4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cc4004800 0x7f3cc4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cc4005270 0x7f3cc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00d4e90 con 0x7f3cc4003a30 2024-05-14T15:21:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc400c1b0 con 0x7f3cc4005270 2024-05-14T15:21:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.316+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc400c3b0 con 0x7f3cc4004800 2024-05-14T15:21:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.317+0000 7f3cdde00640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4003a30 0x7f3cc4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.317+0000 7f3cdd400640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cc4004800 0x7f3cc4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.317+0000 7f3cde800640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cc4005270 0x7f3cc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.318+0000 7f3cdd400640 1 -- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cc4005270 msgr2=0x7f3cc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.318+0000 7f3cdd400640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cc4005270 0x7f3cc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.318+0000 7f3cdd400640 1 -- 172.21.15.2:0/931528977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4003a30 msgr2=0x7f3cc4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.318+0000 7f3cdd400640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4003a30 0x7f3cc4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.318+0000 7f3cdd400640 1 -- 172.21.15.2:0/931528977 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce00d5170 con 0x7f3cc4004800 2024-05-14T15:21:25.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.320+0000 7f3cdd400640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cc4004800 0x7f3cc4004c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001730 tx=0x7f3cc4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e895fcb9fbd8322 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:25.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.320+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc001350 con 0x7f3cc4004800 2024-05-14T15:21:25.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.321+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0052d0 con 0x7f3cc4004800 2024-05-14T15:21:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.321+0000 7f3cdca00640 1 -- 172.21.15.2:0/931528977 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc02aac0 con 0x7f3cc4004800 2024-05-14T15:21:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.321+0000 7f3cdf200640 1 -- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cc4004800 msgr2=0x7f3cc4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.321+0000 7f3cdf200640 1 --2- 172.21.15.2:0/931528977 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cc4004800 0x7f3cc4004c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001730 tx=0x7f3cc4005830 comp rx=0 tx=0).stop 2024-05-14T15:21:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.321+0000 7f3cde800640 1 -- 172.21.15.2:0/931528977 reap_dead start 2024-05-14T15:21:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.322+0000 7f3cdf200640 1 -- 172.21.15.2:0/931528977 shutdown_connections 2024-05-14T15:21:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.322+0000 7f3cdf200640 1 -- 172.21.15.2:0/931528977 >> 172.21.15.2:0/931528977 conn(0x7f3ce00b7600 msgr2=0x7f3ce00b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.322+0000 7f3cdf200640 1 -- 172.21.15.2:0/931528977 shutdown_connections 2024-05-14T15:21:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.322+0000 7f3cdf200640 1 -- 172.21.15.2:0/931528977 wait complete. 2024-05-14T15:21:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.324+0000 7f3cdf200640 1 Processor -- start 2024-05-14T15:21:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.324+0000 7f3cdf200640 1 -- start start 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 0x7f3ce0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce015bd80 0x7f3ce0141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdf200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce01eba10 0x7f3ce01ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00d1500 con 0x7f3cc4004800 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdf200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00d1380 con 0x7f3ce01eba10 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00d4310 con 0x7f3ce015bd80 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 0x7f3ce0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 0x7f3ce0158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54566/0 (socket says 172.21.15.2:54566) 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.326+0000 7f3cdde00640 1 -- 172.21.15.2:0/572224441 learned_addr learned my addr 172.21.15.2:0/572224441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cde800640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce01eba10 0x7f3ce01ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdd400640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce015bd80 0x7f3ce0141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdde00640 1 -- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce015bd80 msgr2=0x7f3ce0141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdde00640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce015bd80 0x7f3ce0141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdde00640 1 -- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce01eba10 msgr2=0x7f3ce01ebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdde00640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce01eba10 0x7f3ce01ebe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdde00640 1 -- 172.21.15.2:0/572224441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01ec360 con 0x7f3cc4004800 2024-05-14T15:21:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cdde00640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 0x7f3ce0158eb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000b720 tx=0x7f3cd000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0018070 con 0x7f3cc4004800 2024-05-14T15:21:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.327+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd0010830 con 0x7f3cc4004800 2024-05-14T15:21:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.328+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce01eac50 con 0x7f3cc4004800 2024-05-14T15:21:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.328+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0010c00 con 0x7f3cc4004800 2024-05-14T15:21:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.328+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01eb210 con 0x7f3cc4004800 2024-05-14T15:21:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.329+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce0154f50 con 0x7f3cc4004800 2024-05-14T15:21:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.330+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3cd001b070 con 0x7f3cc4004800 2024-05-14T15:21:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.331+0000 7f3cd6000640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3cc00762d0 0x7f3cc00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.331+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f3cd0097880 con 0x7f3cc4004800 2024-05-14T15:21:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.332+0000 7f3cdd400640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3cc00762d0 0x7f3cc00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.333+0000 7f3cdd400640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3cc00762d0 0x7f3cc00787e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc032000 tx=0x7f3ccc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.336+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ce0154f50 con 0x7f3cc4004800 2024-05-14T15:21:25.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:25.618+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7f3ce0050870 con 0x7f3cc4004800 2024-05-14T15:21:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.463+0000 7f3cd6000640 1 -- 172.21.15.2:0/572224441 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v234) ==== 120+0+0 (secure 0 0 0) 0x7f3ce01ec360 con 0x7f3cc4004800 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3cc00762d0 msgr2=0x7f3cc00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3cc00762d0 0x7f3cc00787e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc032000 tx=0x7f3ccc02e000 comp rx=0 tx=0).stop 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 msgr2=0x7f3ce0158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 0x7f3ce0158eb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000b720 tx=0x7f3cd000bbe0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 shutdown_connections 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f3cc00762d0 0x7f3cc00787e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce01eba10 0x7f3ce01ebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce015bd80 0x7f3ce0141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 --2- 172.21.15.2:0/572224441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cc4004800 0x7f3ce0158eb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 >> 172.21.15.2:0/572224441 conn(0x7f3ce00b7600 msgr2=0x7f3ce01626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 shutdown_connections 2024-05-14T15:21:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:26.467+0000 7f3cdf200640 1 -- 172.21.15.2:0/572224441 wait complete. 2024-05-14T15:21:26.497 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2024-05-14T15:21:26.497 INFO:tasks.cephfs_test_runner: 2024-05-14T15:21:26.497 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-14T15:21:26.497 INFO:tasks.cephfs_test_runner:Ran 1 test in 286.136s 2024-05-14T15:21:26.497 INFO:tasks.cephfs_test_runner: 2024-05-14T15:21:26.498 INFO:tasks.cephfs_test_runner:OK 2024-05-14T15:21:26.498 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-14T15:21:26.508 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-14T15:21:26.557 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-14T15:21:26.557 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:21:26.557 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:26.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T15:21:26.618 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-05-14T15:21:26.618 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:26.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T15:21:26.675 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:21:26.675 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:26.731 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T15:21:26.732 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-05-14T15:21:26.732 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:21:26.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T15:21:26.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:26.782 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-05-14T15:21:26.878 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-14T15:21:26.878 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-14T15:21:26.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:26.879 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T15:21:26.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:26.965 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T15:21:27.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:27.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2024-05-14T15:21:27.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:27.146 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-05-14T15:21:27.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T15:21:27.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-14T15:21:27.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:27.208 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T15:21:27.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:27.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T15:21:27.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:27.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-05-14T15:21:27.491 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-14T15:21:27.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T15:21:27.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:27.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.760+0000 7f5c6e600640 1 Processor -- start 2024-05-14T15:21:27.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.760+0000 7f5c6e600640 1 -- start start 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6e600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c680d1050 0x7f5c68070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6e600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c68070e80 0x7f5c6806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6e600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6806e050 con 0x7f5c6806dc40 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6e600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f5c681624e0 con 0x7f5c680d1050 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6e600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f5c681618d0 con 0x7f5c68070e80 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c680d1050 0x7f5c68070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6dc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c6806dc40 0x7f5c6806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55126/0 (socket says 172.21.15.2:55126) 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.762+0000 7f5c6dc00640 1 -- 172.21.15.2:0/3891026097 learned_addr learned my addr 172.21.15.2:0/3891026097 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c67e00640 1 --2- 172.21.15.2:0/3891026097 >> v2:172.21.15.156:3300/0 conn(0x7f5c68070e80 0x7f5c6806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c6d200640 1 -- 172.21.15.2:0/3891026097 >> v2:172.21.15.156:3300/0 conn(0x7f5c68070e80 msgr2=0x7f5c6806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c6d200640 1 --2- 172.21.15.2:0/3891026097 >> v2:172.21.15.156:3300/0 conn(0x7f5c68070e80 0x7f5c6806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c6d200640 1 -- 172.21.15.2:0/3891026097 >> v1:172.21.15.2:6789/0 conn(0x7f5c6806dc40 legacy=0x7f5c6806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c6d200640 1 -- 172.21.15.2:0/3891026097 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c68161bb0 con 0x7f5c680d1050 2024-05-14T15:21:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c67400640 1 -- 172.21.15.2:0/3891026097 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878044184 0 0) 0x7f5c60001490 con 0x7f5c6806dc40 2024-05-14T15:21:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.763+0000 7f5c67e00640 1 --2- 172.21.15.2:0/3891026097 >> v2:172.21.15.156:3300/0 conn(0x7f5c68070e80 0x7f5c6806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.764+0000 7f5c6d200640 1 --2- 172.21.15.2:0/3891026097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c680d1050 0x7f5c68070940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5c6809faa0 tx=0x7f5c5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac96f89b24ddec07 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.764+0000 7f5c67400640 1 -- 172.21.15.2:0/3891026097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c037070 con 0x7f5c680d1050 2024-05-14T15:21:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.764+0000 7f5c67400640 1 -- 172.21.15.2:0/3891026097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5c032440 con 0x7f5c680d1050 2024-05-14T15:21:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.764+0000 7f5c67400640 1 -- 172.21.15.2:0/3891026097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c032810 con 0x7f5c680d1050 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 -- 172.21.15.2:0/3891026097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c680d1050 msgr2=0x7f5c68070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 --2- 172.21.15.2:0/3891026097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c680d1050 0x7f5c68070940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5c6809faa0 tx=0x7f5c5c02a1a0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 -- 172.21.15.2:0/3891026097 shutdown_connections 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 --2- 172.21.15.2:0/3891026097 >> v2:172.21.15.156:3300/0 conn(0x7f5c68070e80 0x7f5c6806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 --2- 172.21.15.2:0/3891026097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c680d1050 0x7f5c68070940 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 -- 172.21.15.2:0/3891026097 >> 172.21.15.2:0/3891026097 conn(0x7f5c680732e0 msgr2=0x7f5c680736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 -- 172.21.15.2:0/3891026097 shutdown_connections 2024-05-14T15:21:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.765+0000 7f5c6e600640 1 -- 172.21.15.2:0/3891026097 wait complete. 2024-05-14T15:21:27.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.768+0000 7f5c6e600640 1 Processor -- start 2024-05-14T15:21:27.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.768+0000 7f5c6e600640 1 -- start start 2024-05-14T15:21:27.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.769+0000 7f5c6e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 0x7f5c68154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.769+0000 7f5c6e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c68070e80 0x7f5c680aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6e600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c680d1050 0x7f5c680af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6e600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6815f110 con 0x7f5c6806dc40 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6e600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5c68162170 con 0x7f5c68070e80 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6e600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6815f290 con 0x7f5c680d1050 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 0x7f5c68154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 0x7f5c68154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54574/0 (socket says 172.21.15.2:54574) 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 -- 172.21.15.2:0/1439987275 learned_addr learned my addr 172.21.15.2:0/1439987275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c67e00640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c68070e80 0x7f5c680aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 -- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c680d1050 msgr2=0x7f5c680af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c680d1050 0x7f5c680af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 -- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c68070e80 msgr2=0x7f5c680aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c68070e80 0x7f5c680aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.770+0000 7f5c6d200640 1 -- 172.21.15.2:0/1439987275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6809e550 con 0x7f5c6806dc40 2024-05-14T15:21:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.771+0000 7f5c6d200640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 0x7f5c68154050 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009890 tx=0x7f5c5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.771+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c037040 con 0x7f5c6806dc40 2024-05-14T15:21:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.771+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5c042070 con 0x7f5c6806dc40 2024-05-14T15:21:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.771+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6809e830 con 0x7f5c6806dc40 2024-05-14T15:21:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.771+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c030bd0 con 0x7f5c6806dc40 2024-05-14T15:21:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.771+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c681f4a20 con 0x7f5c6806dc40 2024-05-14T15:21:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.773+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c680698d0 con 0x7f5c6806dc40 2024-05-14T15:21:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.774+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c5c047460 con 0x7f5c6806dc40 2024-05-14T15:21:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.775+0000 7f5c64c00640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5c480762d0 0x7f5c480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.776+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f5c5c0b8060 con 0x7f5c6806dc40 2024-05-14T15:21:27.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.776+0000 7f5c67e00640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5c480762d0 0x7f5c480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.777+0000 7f5c67e00640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5c480762d0 0x7f5c480787e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c680b1200 tx=0x7f5c54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:27.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.781+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c680698d0 con 0x7f5c6806dc40 2024-05-14T15:21:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.985+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c681f4550 con 0x7f5c480762d0 2024-05-14T15:21:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.988+0000 7f5c64c00640 1 -- 172.21.15.2:0/1439987275 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13476 (secure 0 0 0) 0x7f5c681f4550 con 0x7f5c480762d0 2024-05-14T15:21:27.988 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5c480762d0 msgr2=0x7f5c480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5c480762d0 0x7f5c480787e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c680b1200 tx=0x7f5c54008040 comp rx=0 tx=0).stop 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 msgr2=0x7f5c68154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 0x7f5c68154050 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009890 tx=0x7f5c5c0046c0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 shutdown_connections 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f5c480762d0 0x7f5c480787e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c68070e80 0x7f5c680aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c680d1050 0x7f5c680af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 --2- 172.21.15.2:0/1439987275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6806dc40 0x7f5c68154050 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 >> 172.21.15.2:0/1439987275 conn(0x7f5c680732e0 msgr2=0x7f5c680b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 shutdown_connections 2024-05-14T15:21:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:27.991+0000 7f5c6e600640 1 -- 172.21.15.2:0/1439987275 wait complete. 2024-05-14T15:21:28.021 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-05-14T15:21:26.994168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":254704,"kb_used_data":5240,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720016,"statfs":{"total":773094113280,"available":772833296384,"internally_reserved":0,"allocated":5365760,"data_stored":2988862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7834,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002349"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-14T15:21:25.916975+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:21:25.916975+0000","last_peered":"2024-05-14T15:21:25.916975+0000","last_clean":"2024-05-14T15:21:25.916975+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:21:25.916975+0000","last_undegraded":"2024-05-14T15:21:25.916975+0000","last_fullsized":"2024-05-14T15:21:25.916975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542217,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":220729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:28.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.308+0000 7fc2ce400640 1 Processor -- start 2024-05-14T15:21:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.308+0000 7fc2ce400640 1 -- start start 2024-05-14T15:21:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2ce400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2c806d700 0x7fc2c806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2ce400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80ae750 0x7fc2c80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2ce400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c806e050 con 0x7fc2c80d1050 2024-05-14T15:21:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2ce400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c81624e0 con 0x7fc2c806d700 2024-05-14T15:21:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2ce400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c81618d0 con 0x7fc2c80ae750 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2c7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2c806d700 0x7fc2c806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2c7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2c806d700 0x7fc2c806db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54580/0 (socket says 172.21.15.2:54580) 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2c7e00640 1 -- 172.21.15.2:0/2272220218 learned_addr learned my addr 172.21.15.2:0/2272220218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.311+0000 7fc2cda00640 1 --2- 172.21.15.2:0/2272220218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80ae750 0x7fc2c80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.312+0000 7fc2c7e00640 1 -- 172.21.15.2:0/2272220218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80ae750 msgr2=0x7fc2c80aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.312+0000 7fc2c7e00640 1 --2- 172.21.15.2:0/2272220218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80ae750 0x7fc2c80aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.312+0000 7fc2c7e00640 1 -- 172.21.15.2:0/2272220218 >> v1:172.21.15.156:6789/0 conn(0x7fc2c80d1050 legacy=0x7fc2c8070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.312+0000 7fc2c7e00640 1 -- 172.21.15.2:0/2272220218 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c8161bb0 con 0x7fc2c806d700 2024-05-14T15:21:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.313+0000 7fc2c7e00640 1 --2- 172.21.15.2:0/2272220218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c806d700 0x7fc2c806db10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009870 tx=0x7fc2b402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a5851f82f8f2ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.313+0000 7fc2c7400640 1 -- 172.21.15.2:0/2272220218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4037070 con 0x7fc2c806d700 2024-05-14T15:21:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.313+0000 7fc2c7400640 1 -- 172.21.15.2:0/2272220218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4032440 con 0x7fc2c806d700 2024-05-14T15:21:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.313+0000 7fc2c7400640 1 -- 172.21.15.2:0/2272220218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4032810 con 0x7fc2c806d700 2024-05-14T15:21:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 -- 172.21.15.2:0/2272220218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c806d700 msgr2=0x7fc2c806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 --2- 172.21.15.2:0/2272220218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c806d700 0x7fc2c806db10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009870 tx=0x7fc2b402a1c0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 -- 172.21.15.2:0/2272220218 shutdown_connections 2024-05-14T15:21:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 --2- 172.21.15.2:0/2272220218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80ae750 0x7fc2c80aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 --2- 172.21.15.2:0/2272220218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c806d700 0x7fc2c806db10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 -- 172.21.15.2:0/2272220218 >> 172.21.15.2:0/2272220218 conn(0x7fc2c80732e0 msgr2=0x7fc2c80736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 -- 172.21.15.2:0/2272220218 shutdown_connections 2024-05-14T15:21:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.314+0000 7fc2ce400640 1 -- 172.21.15.2:0/2272220218 wait complete. 2024-05-14T15:21:28.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.317+0000 7fc2ce400640 1 Processor -- start 2024-05-14T15:21:28.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.317+0000 7fc2ce400640 1 -- start start 2024-05-14T15:21:28.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2ce400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2c806d700 0x7fc2c814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2ce400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 0x7fc2c80cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2ce400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80d1050 0x7fc2c8153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2ce400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8071050 con 0x7fc2c80ae750 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2ce400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8162170 con 0x7fc2c806d700 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2ce400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c815f110 con 0x7fc2c80d1050 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 0x7fc2c80cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 0x7fc2c80cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54596/0 (socket says 172.21.15.2:54596) 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2c7e00640 1 -- 172.21.15.2:0/829630292 learned_addr learned my addr 172.21.15.2:0/829630292 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.319+0000 7fc2cd000640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2c806d700 0x7fc2c814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2cda00640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80d1050 0x7fc2c8153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c7e00640 1 -- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80d1050 msgr2=0x7fc2c8153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c7e00640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80d1050 0x7fc2c8153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c7e00640 1 -- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2c806d700 msgr2=0x7fc2c814b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c7e00640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2c806d700 0x7fc2c814b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c7e00640 1 -- 172.21.15.2:0/829630292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c80ce820 con 0x7fc2c80ae750 2024-05-14T15:21:28.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2cd000640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2c806d700 0x7fc2c814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:28.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2cda00640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80d1050 0x7fc2c8153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c7e00640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 0x7fc2c80cff50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000c00 tx=0x7fc2b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4041070 con 0x7fc2c80ae750 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b403c870 con 0x7fc2c80ae750 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4037040 con 0x7fc2c80ae750 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.320+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c80ceac0 con 0x7fc2c80ae750 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.321+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c80cf080 con 0x7fc2c80ae750 2024-05-14T15:21:28.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.322+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c8050870 con 0x7fc2c80ae750 2024-05-14T15:21:28.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.323+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc2b4044070 con 0x7fc2c80ae750 2024-05-14T15:21:28.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.324+0000 7fc2c4c00640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2a80762d0 0x7fc2a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.324+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fc2b40b7fe0 con 0x7fc2c80ae750 2024-05-14T15:21:28.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.325+0000 7fc2cd000640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2a80762d0 0x7fc2a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.326+0000 7fc2cd000640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2a80762d0 0x7fc2a80787e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8074f20 tx=0x7fc2b80073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:28.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.329+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc2c806e050 con 0x7fc2c80ae750 2024-05-14T15:21:28.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.538+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2c809f860 con 0x7fc2a80762d0 2024-05-14T15:21:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.540+0000 7fc2c4c00640 1 -- 172.21.15.2:0/829630292 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13476 (secure 0 0 0) 0x7fc2c809f860 con 0x7fc2a80762d0 2024-05-14T15:21:28.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:21:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2a80762d0 msgr2=0x7fc2a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2a80762d0 0x7fc2a80787e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8074f20 tx=0x7fc2b80073a0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 msgr2=0x7fc2c80cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 0x7fc2c80cff50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000c00 tx=0x7fc2b40046c0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 shutdown_connections 2024-05-14T15:21:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc2a80762d0 0x7fc2a80787e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc2c80d1050 0x7fc2c8153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2c80ae750 0x7fc2c80cff50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 --2- 172.21.15.2:0/829630292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2c806d700 0x7fc2c814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 >> 172.21.15.2:0/829630292 conn(0x7fc2c80732e0 msgr2=0x7fc2c8156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 shutdown_connections 2024-05-14T15:21:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.543+0000 7fc2ce400640 1 -- 172.21.15.2:0/829630292 wait complete. 2024-05-14T15:21:28.571 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-05-14T15:21:26.994168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":254704,"kb_used_data":5240,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720016,"statfs":{"total":773094113280,"available":772833296384,"internally_reserved":0,"allocated":5365760,"data_stored":2988862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7834,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002349"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-14T15:21:25.916975+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:21:25.916975+0000","last_peered":"2024-05-14T15:21:25.916975+0000","last_clean":"2024-05-14T15:21:25.916975+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:21:25.916975+0000","last_undegraded":"2024-05-14T15:21:25.916975+0000","last_fullsized":"2024-05-14T15:21:25.916975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542217,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":220729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:28.572 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T15:21:28.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:28.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.857+0000 7f4b7ac00640 1 Processor -- start 2024-05-14T15:21:28.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.857+0000 7f4b7ac00640 1 -- start start 2024-05-14T15:21:28.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b7ac00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b7415bb90 0x7f4b7415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b7ac00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b740d1460 con 0x7f4b7406d700 2024-05-14T15:21:28.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b7ac00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7415ed90 con 0x7f4b74071530 2024-05-14T15:21:28.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b7ac00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7415f350 con 0x7f4b7415bb90 2024-05-14T15:21:28.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b73e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b7415bb90 0x7f4b7415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b78c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4b7406d700 0x7f4b7406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55134/0 (socket says 172.21.15.2:55134) 2024-05-14T15:21:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.860+0000 7f4b78c00640 1 -- 172.21.15.2:0/1572309010 learned_addr learned my addr 172.21.15.2:0/1572309010 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.861+0000 7f4b72a00640 1 -- 172.21.15.2:0/1572309010 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540581078 0 0) 0x7f4b740d1460 con 0x7f4b7406d700 2024-05-14T15:21:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.861+0000 7f4b72a00640 1 -- 172.21.15.2:0/1572309010 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b58003520 con 0x7f4b7406d700 2024-05-14T15:21:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.861+0000 7f4b73e00640 1 -- 172.21.15.2:0/1572309010 >> v1:172.21.15.156:6789/0 conn(0x7f4b74071530 legacy=0x7f4b740af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.861+0000 7f4b73e00640 1 -- 172.21.15.2:0/1572309010 >> v1:172.21.15.2:6789/0 conn(0x7f4b7406d700 legacy=0x7f4b7406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.861+0000 7f4b73e00640 1 -- 172.21.15.2:0/1572309010 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7415f070 con 0x7f4b7415bb90 2024-05-14T15:21:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.862+0000 7f4b73e00640 1 --2- 172.21.15.2:0/1572309010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7415bb90 0x7f4b7415e440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b640097a0 tx=0x7f4b6402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6168251876cc3f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.863+0000 7f4b72a00640 1 -- 172.21.15.2:0/1572309010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64037070 con 0x7f4b7415bb90 2024-05-14T15:21:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.863+0000 7f4b72a00640 1 -- 172.21.15.2:0/1572309010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6402adb0 con 0x7f4b7415bb90 2024-05-14T15:21:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.863+0000 7f4b72a00640 1 -- 172.21.15.2:0/1572309010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64032660 con 0x7f4b7415bb90 2024-05-14T15:21:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 -- 172.21.15.2:0/1572309010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7415bb90 msgr2=0x7f4b7415e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/1572309010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7415bb90 0x7f4b7415e440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b640097a0 tx=0x7f4b6402a060 comp rx=0 tx=0).stop 2024-05-14T15:21:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 -- 172.21.15.2:0/1572309010 shutdown_connections 2024-05-14T15:21:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/1572309010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7415bb90 0x7f4b7415e440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 -- 172.21.15.2:0/1572309010 >> 172.21.15.2:0/1572309010 conn(0x7f4b740d1d10 msgr2=0x7f4b740734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 -- 172.21.15.2:0/1572309010 shutdown_connections 2024-05-14T15:21:28.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.864+0000 7f4b7ac00640 1 -- 172.21.15.2:0/1572309010 wait complete. 2024-05-14T15:21:28.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.867+0000 7f4b7ac00640 1 Processor -- start 2024-05-14T15:21:28.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.867+0000 7f4b7ac00640 1 -- start start 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.869+0000 7f4b7ac00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b7406d700 0x7f4b741e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.869+0000 7f4b7ac00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 0x7f4b741e5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b7ac00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b7415bb90 0x7f4b741e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b7ac00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b740aeb60 con 0x7f4b74071530 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b7ac00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4b740af790 con 0x7f4b7415bb90 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b7ac00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7415e980 con 0x7f4b7406d700 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b73400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 0x7f4b741e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b73400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 0x7f4b741e5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54614/0 (socket says 172.21.15.2:54614) 2024-05-14T15:21:28.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b73400640 1 -- 172.21.15.2:0/3917842882 learned_addr learned my addr 172.21.15.2:0/3917842882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b73e00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b7406d700 0x7f4b741e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.870+0000 7f4b78c00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b7415bb90 0x7f4b741e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b73400640 1 -- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b7406d700 msgr2=0x7f4b741e5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b73400640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b7406d700 0x7f4b741e5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b73400640 1 -- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b7415bb90 msgr2=0x7f4b741e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b73400640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b7415bb90 0x7f4b741e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b73400640 1 -- 172.21.15.2:0/3917842882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b741e42b0 con 0x7f4b74071530 2024-05-14T15:21:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b78c00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b7415bb90 0x7f4b741e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b73400640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 0x7f4b741e5350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00b420 tx=0x7f4b5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c011830 con 0x7f4b74071530 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c016070 con 0x7f4b74071530 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b741e4590 con 0x7f4b74071530 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.871+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c011c10 con 0x7f4b74071530 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.872+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b741e4b50 con 0x7f4b74071530 2024-05-14T15:21:28.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.873+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b74050870 con 0x7f4b74071530 2024-05-14T15:21:28.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.874+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4b5c01b460 con 0x7f4b74071530 2024-05-14T15:21:28.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.875+0000 7f4b6be00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4b50076300 0x7f4b50078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:28.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.875+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f4b5c096fe0 con 0x7f4b74071530 2024-05-14T15:21:28.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.876+0000 7f4b73e00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4b50076300 0x7f4b50078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:28.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.878+0000 7f4b73e00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4b50076300 0x7f4b50078810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b64034000 tx=0x7f4b6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:28.881+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4b5c020020 con 0x7f4b74071530 2024-05-14T15:21:29.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.084+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b741e6410 con 0x7f4b50076300 2024-05-14T15:21:29.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.086+0000 7f4b6be00640 1 -- 172.21.15.2:0/3917842882 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13476 (secure 0 0 0) 0x7f4b640454c0 con 0x7f4b50076300 2024-05-14T15:21:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:29.087 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:21:29.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4b50076300 msgr2=0x7f4b50078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4b50076300 0x7f4b50078810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b64034000 tx=0x7f4b6402e000 comp rx=0 tx=0).stop 2024-05-14T15:21:29.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 msgr2=0x7f4b741e5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 0x7f4b741e5350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00b420 tx=0x7f4b5c00b8e0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 shutdown_connections 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4b50076300 0x7f4b50078810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b7415bb90 0x7f4b741e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b74071530 0x7f4b741e5350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 --2- 172.21.15.2:0/3917842882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b7406d700 0x7f4b741e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 >> 172.21.15.2:0/3917842882 conn(0x7f4b740d1d10 msgr2=0x7f4b740af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 shutdown_connections 2024-05-14T15:21:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.089+0000 7f4b7ac00640 1 -- 172.21.15.2:0/3917842882 wait complete. 2024-05-14T15:21:29.116 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-14T15:21:28.994748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":254704,"kb_used_data":5240,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720016,"statfs":{"total":773094113280,"available":772833296384,"internally_reserved":0,"allocated":5365760,"data_stored":2988862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7834,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.579206"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":154,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-14T15:21:25.916975+0000","last_change":"2024-05-14T15:15:38.346788+0000","last_active":"2024-05-14T15:21:25.916975+0000","last_peered":"2024-05-14T15:21:25.916975+0000","last_clean":"2024-05-14T15:21:25.916975+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:21:25.916975+0000","last_undegraded":"2024-05-14T15:21:25.916975+0000","last_fullsized":"2024-05-14T15:21:25.916975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:15:37.327212+0000","last_clean_scrub_stamp":"2024-05-14T15:15:37.327212+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:58.067620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542217,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":220729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:29.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:21:29.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.386+0000 7fbced000640 1 Processor -- start 2024-05-14T15:21:29.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.386+0000 7fbced000640 1 -- start start 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.388+0000 7fbced000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbce8071530 0x7fbce80af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.388+0000 7fbced000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbce806d700 0x7fbce806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbced000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce80d1460 con 0x7fbce815bb90 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbced000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fbce815eb50 con 0x7fbce8071530 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbced000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fbce815f350 con 0x7fbce806d700 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbce8071530 0x7fbce80af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbce8071530 0x7fbce80af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54628/0 (socket says 172.21.15.2:54628) 2024-05-14T15:21:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 -- 172.21.15.2:0/1360575708 learned_addr learned my addr 172.21.15.2:0/1360575708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce6800640 1 --2- 172.21.15.2:0/1360575708 >> v2:172.21.15.156:3300/0 conn(0x7fbce806d700 0x7fbce806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 -- 172.21.15.2:0/1360575708 >> v2:172.21.15.156:3300/0 conn(0x7fbce806d700 msgr2=0x7fbce806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 --2- 172.21.15.2:0/1360575708 >> v2:172.21.15.156:3300/0 conn(0x7fbce806d700 0x7fbce806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 -- 172.21.15.2:0/1360575708 >> v1:172.21.15.156:6789/0 conn(0x7fbce815bb90 legacy=0x7fbce815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce5400640 1 -- 172.21.15.2:0/1360575708 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce806e050 con 0x7fbce8071530 2024-05-14T15:21:29.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.389+0000 7fbce6800640 1 --2- 172.21.15.2:0/1360575708 >> v2:172.21.15.156:3300/0 conn(0x7fbce806d700 0x7fbce806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:29.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.391+0000 7fbce5400640 1 --2- 172.21.15.2:0/1360575708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce8071530 0x7fbce80af080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbce80ce1d0 tx=0x7fbcd402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1f2df75f894f91 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:29.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.391+0000 7fbce4a00640 1 -- 172.21.15.2:0/1360575708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4037070 con 0x7fbce8071530 2024-05-14T15:21:29.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.391+0000 7fbce4a00640 1 -- 172.21.15.2:0/1360575708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd402ae00 con 0x7fbce8071530 2024-05-14T15:21:29.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.391+0000 7fbce4a00640 1 -- 172.21.15.2:0/1360575708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4032660 con 0x7fbce8071530 2024-05-14T15:21:29.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.392+0000 7fbced000640 1 -- 172.21.15.2:0/1360575708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce8071530 msgr2=0x7fbce80af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.392+0000 7fbced000640 1 --2- 172.21.15.2:0/1360575708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce8071530 0x7fbce80af080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbce80ce1d0 tx=0x7fbcd402a0b0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.392+0000 7fbced000640 1 -- 172.21.15.2:0/1360575708 shutdown_connections 2024-05-14T15:21:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.392+0000 7fbced000640 1 --2- 172.21.15.2:0/1360575708 >> v2:172.21.15.156:3300/0 conn(0x7fbce806d700 0x7fbce806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.392+0000 7fbced000640 1 --2- 172.21.15.2:0/1360575708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce8071530 0x7fbce80af080 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.392+0000 7fbced000640 1 -- 172.21.15.2:0/1360575708 >> 172.21.15.2:0/1360575708 conn(0x7fbce80d1d10 msgr2=0x7fbce80734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.393+0000 7fbced000640 1 -- 172.21.15.2:0/1360575708 shutdown_connections 2024-05-14T15:21:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.393+0000 7fbced000640 1 -- 172.21.15.2:0/1360575708 wait complete. 2024-05-14T15:21:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.396+0000 7fbced000640 1 Processor -- start 2024-05-14T15:21:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.396+0000 7fbced000640 1 -- start start 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbced000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 0x7fbce81e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbced000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbce8071530 0x7fbce81f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbced000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbce815bb90 0x7fbce81fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbced000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbce80ae880 con 0x7fbce806d700 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbced000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbce815f070 con 0x7fbce815bb90 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbced000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbce80aeb60 con 0x7fbce8071530 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbce5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 0x7fbce81e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbce5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 0x7fbce81e4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54632/0 (socket says 172.21.15.2:54632) 2024-05-14T15:21:29.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbce5e00640 1 -- 172.21.15.2:0/936407758 learned_addr learned my addr 172.21.15.2:0/936407758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbce6800640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbce815bb90 0x7fbce81fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.398+0000 7fbce5400640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbce8071530 0x7fbce81f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5e00640 1 -- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbce8071530 msgr2=0x7fbce81f9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5e00640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbce8071530 0x7fbce81f9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5e00640 1 -- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbce815bb90 msgr2=0x7fbce81fa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5e00640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbce815bb90 0x7fbce81fa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5e00640 1 -- 172.21.15.2:0/936407758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce81e5750 con 0x7fbce806d700 2024-05-14T15:21:29.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5400640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbce8071530 0x7fbce81f9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbce5e00640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 0x7fbce81e4c60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b9e0 tx=0x7fbcd800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8019070 con 0x7fbce806d700 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd800cba0 con 0x7fbce806d700 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8014440 con 0x7fbce806d700 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.399+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce81e5a30 con 0x7fbce806d700 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.400+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce814b250 con 0x7fbce806d700 2024-05-14T15:21:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.401+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce81e5c00 con 0x7fbce806d700 2024-05-14T15:21:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.402+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbcd801c070 con 0x7fbce806d700 2024-05-14T15:21:29.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.403+0000 7fbcde000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcc80762d0 0x7fbcc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:29.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.403+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fbcd8097270 con 0x7fbce806d700 2024-05-14T15:21:29.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.404+0000 7fbce5400640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcc80762d0 0x7fbcc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:29.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.405+0000 7fbce5400640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcc80762d0 0x7fbcc80787e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4034000 tx=0x7fbcd402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.408+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbce81e5c00 con 0x7fbce806d700 2024-05-14T15:21:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.618+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbce80d1210 con 0x7fbce806d700 2024-05-14T15:21:29.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.620+0000 7fbcde000640 1 -- 172.21.15.2:0/936407758 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13219 (secure 0 0 0) 0x7fbcd80605c0 con 0x7fbce806d700 2024-05-14T15:21:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:29.620 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"fsid":"c9147305-965e-4a8b-a03b-3f802813a40c","created":"2024-05-14T15:15:23.550357+0000","modified":"2024-05-14T15:21:24.430710+0000","last_up_change":"2024-05-14T15:15:36.323073+0000","last_in_change":"2024-05-14T15:15:27.508961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:15:36.876399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15320c4-daa5-4174-a709-b8cc549256cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6809","nonce":3972517232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6811","nonce":3972517232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6816","nonce":3972517232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3972517232},{"type":"v1","addr":"172.21.15.2:6813","nonce":3972517232}]},"public_addr":"172.21.15.2:6809/3972517232","cluster_addr":"172.21.15.2:6811/3972517232","heartbeat_back_addr":"172.21.15.2:6816/3972517232","heartbeat_front_addr":"172.21.15.2:6813/3972517232","state":["exists","up"]},{"osd":1,"uuid":"a1deaf7a-40ad-458f-85c0-aadf6ef78c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6822","nonce":709711277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6826","nonce":709711277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6831","nonce":709711277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":709711277},{"type":"v1","addr":"172.21.15.2:6829","nonce":709711277}]},"public_addr":"172.21.15.2:6822/709711277","cluster_addr":"172.21.15.2:6826/709711277","heartbeat_back_addr":"172.21.15.2:6831/709711277","heartbeat_front_addr":"172.21.15.2:6829/709711277","state":["exists","up"]},{"osd":2,"uuid":"3801e264-cb7c-4046-945d-74be2c93e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6815","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6817","nonce":216526144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6819","nonce":216526144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6827","nonce":216526144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":216526144},{"type":"v1","addr":"172.21.15.2:6823","nonce":216526144}]},"public_addr":"172.21.15.2:6817/216526144","cluster_addr":"172.21.15.2:6819/216526144","heartbeat_back_addr":"172.21.15.2:6827/216526144","heartbeat_front_addr":"172.21.15.2:6823/216526144","state":["exists","up"]},{"osd":3,"uuid":"2d934743-8594-4f6d-a6cb-02dda84df2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6801","nonce":2884583722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6803","nonce":2884583722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6807","nonce":2884583722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":2884583722},{"type":"v1","addr":"172.21.15.2:6805","nonce":2884583722}]},"public_addr":"172.21.15.2:6801/2884583722","cluster_addr":"172.21.15.2:6803/2884583722","heartbeat_back_addr":"172.21.15.2:6807/2884583722","heartbeat_front_addr":"172.21.15.2:6805/2884583722","state":["exists","up"]},{"osd":4,"uuid":"665abbaf-7c1d-46bd-9fbd-c8a5bc65972b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6825","nonce":1273361273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6827","nonce":1273361273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6831","nonce":1273361273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":1273361273},{"type":"v1","addr":"172.21.15.156:6829","nonce":1273361273}]},"public_addr":"172.21.15.156:6825/1273361273","cluster_addr":"172.21.15.156:6827/1273361273","heartbeat_back_addr":"172.21.15.156:6831/1273361273","heartbeat_front_addr":"172.21.15.156:6829/1273361273","state":["exists","up"]},{"osd":5,"uuid":"6685a14d-72ed-43b5-8613-9ec0753f6535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6817","nonce":1465481188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6819","nonce":1465481188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6823","nonce":1465481188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":1465481188},{"type":"v1","addr":"172.21.15.156:6821","nonce":1465481188}]},"public_addr":"172.21.15.156:6817/1465481188","cluster_addr":"172.21.15.156:6819/1465481188","heartbeat_back_addr":"172.21.15.156:6823/1465481188","heartbeat_front_addr":"172.21.15.156:6821/1465481188","state":["exists","up"]},{"osd":6,"uuid":"70829387-5eab-4f47-8704-689f2c52777c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6801","nonce":1299720883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6803","nonce":1299720883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6807","nonce":1299720883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1299720883},{"type":"v1","addr":"172.21.15.156:6805","nonce":1299720883}]},"public_addr":"172.21.15.156:6801/1299720883","cluster_addr":"172.21.15.156:6803/1299720883","heartbeat_back_addr":"172.21.15.156:6807/1299720883","heartbeat_front_addr":"172.21.15.156:6805/1299720883","state":["exists","up"]},{"osd":7,"uuid":"7d6d4dfb-cc36-4f09-bd95-50f8d37fb849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6809","nonce":784939538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6811","nonce":784939538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6815","nonce":784939538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":784939538},{"type":"v1","addr":"172.21.15.156:6813","nonce":784939538}]},"public_addr":"172.21.15.156:6809/784939538","cluster_addr":"172.21.15.156:6811/784939538","heartbeat_back_addr":"172.21.15.156:6815/784939538","heartbeat_front_addr":"172.21.15.156:6813/784939538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.051302+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.302703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.235735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.209399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.823669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.045474+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:32.931542+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:15:33.187785+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/3645921439":"2024-05-15T15:21:21.409387+0000","172.21.15.2:6834/3645921439":"2024-05-15T15:21:21.409387+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:21:29.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcc80762d0 msgr2=0x7fbcc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcc80762d0 0x7fbcc80787e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4034000 tx=0x7fbcd402e000 comp rx=0 tx=0).stop 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 msgr2=0x7fbce81e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 0x7fbce81e4c60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b9e0 tx=0x7fbcd800bea0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 shutdown_connections 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcc80762d0 0x7fbcc80787e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbce815bb90 0x7fbce81fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbce8071530 0x7fbce81f9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 --2- 172.21.15.2:0/936407758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbce806d700 0x7fbce81e4c60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 >> 172.21.15.2:0/936407758 conn(0x7fbce80d1d10 msgr2=0x7fbce806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.622+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 shutdown_connections 2024-05-14T15:21:29.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:29.623+0000 7fbced000640 1 -- 172.21.15.2:0/936407758 wait complete. 2024-05-14T15:21:30.650 INFO:tasks.ceph:Scrubbing osd.0 2024-05-14T15:21:30.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:30.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.935+0000 7f76e6a00640 1 Processor -- start 2024-05-14T15:21:30.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.935+0000 7f76e6a00640 1 -- start start 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.937+0000 7f76e6a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f76e009f570 0x7f76e00af620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.937+0000 7f76e6a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76e00d0a70 0x7f76e015def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.937+0000 7f76e6a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e00d0e80 con 0x7f76e006d700 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.937+0000 7f76e6a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f76e0161b60 con 0x7f76e00d0a70 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.938+0000 7f76e6a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f76e015e430 con 0x7f76e009f570 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.938+0000 7f76df400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76e00d0a70 0x7f76e015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.938+0000 7f76e4a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f76e006d700 0x7f76e006db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34596/0 (socket says 172.21.15.2:34596) 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.938+0000 7f76e4a00640 1 -- 172.21.15.2:0/3932081418 learned_addr learned my addr 172.21.15.2:0/3932081418 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.938+0000 7f76dfe00640 1 --2- 172.21.15.2:0/3932081418 >> v2:172.21.15.156:3300/0 conn(0x7f76e009f570 0x7f76e00af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.939+0000 7f76df400640 1 -- 172.21.15.2:0/3932081418 >> v2:172.21.15.156:3300/0 conn(0x7f76e009f570 msgr2=0x7f76e00af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.939+0000 7f76df400640 1 --2- 172.21.15.2:0/3932081418 >> v2:172.21.15.156:3300/0 conn(0x7f76e009f570 0x7f76e00af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.939+0000 7f76df400640 1 -- 172.21.15.2:0/3932081418 >> v1:172.21.15.2:6789/0 conn(0x7f76e006d700 legacy=0x7f76e006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.939+0000 7f76df400640 1 -- 172.21.15.2:0/3932081418 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0161db0 con 0x7f76e00d0a70 2024-05-14T15:21:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.939+0000 7f76dea00640 1 -- 172.21.15.2:0/3932081418 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955224948 0 0) 0x7f76e00d0e80 con 0x7f76e006d700 2024-05-14T15:21:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.940+0000 7f76df400640 1 --2- 172.21.15.2:0/3932081418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e015def0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f76e0074da0 tx=0x7f76cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722af6bf7cb10f35 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.940+0000 7f76dea00640 1 -- 172.21.15.2:0/3932081418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc037070 con 0x7f76e00d0a70 2024-05-14T15:21:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.940+0000 7f76dea00640 1 -- 172.21.15.2:0/3932081418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc032440 con 0x7f76e00d0a70 2024-05-14T15:21:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.940+0000 7f76dea00640 1 -- 172.21.15.2:0/3932081418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc032810 con 0x7f76e00d0a70 2024-05-14T15:21:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 -- 172.21.15.2:0/3932081418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 msgr2=0x7f76e015def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 --2- 172.21.15.2:0/3932081418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e015def0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f76e0074da0 tx=0x7f76cc02a1a0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 -- 172.21.15.2:0/3932081418 shutdown_connections 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 --2- 172.21.15.2:0/3932081418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e015def0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 --2- 172.21.15.2:0/3932081418 >> v2:172.21.15.156:3300/0 conn(0x7f76e009f570 0x7f76e00af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 -- 172.21.15.2:0/3932081418 >> 172.21.15.2:0/3932081418 conn(0x7f76e00734e0 msgr2=0x7f76e00738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.941+0000 7f76e6a00640 1 -- 172.21.15.2:0/3932081418 shutdown_connections 2024-05-14T15:21:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.942+0000 7f76e6a00640 1 -- 172.21.15.2:0/3932081418 wait complete. 2024-05-14T15:21:30.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.944+0000 7f76e6a00640 1 Processor -- start 2024-05-14T15:21:30.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.944+0000 7f76e6a00640 1 -- start start 2024-05-14T15:21:30.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.945+0000 7f76e6a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76e006d700 0x7f76e0151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.945+0000 7f76e6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76e009f570 0x7f76e01f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e01f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e6a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76e0162650 con 0x7f76e00d0a70 2024-05-14T15:21:30.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e6a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f76e0162370 con 0x7f76e009f570 2024-05-14T15:21:30.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e6a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f76e00cf7e0 con 0x7f76e006d700 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e01f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e01f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45048/0 (socket says 172.21.15.2:45048) 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 -- 172.21.15.2:0/3554746803 learned_addr learned my addr 172.21.15.2:0/3554746803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76df400640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76e009f570 0x7f76e01f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 -- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76e006d700 msgr2=0x7f76e0151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76e006d700 0x7f76e0151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 -- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76e009f570 msgr2=0x7f76e01f9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76e009f570 0x7f76e01f9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76e4a00640 1 -- 172.21.15.2:0/3554746803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e015ffd0 con 0x7f76e00d0a70 2024-05-14T15:21:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.946+0000 7f76df400640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76e009f570 0x7f76e01f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.947+0000 7f76e4a00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e01f9f40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c6b0 tx=0x7f76d800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.947+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8018070 con 0x7f76e00d0a70 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.947+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8004da0 con 0x7f76e00d0a70 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.947+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d800a880 con 0x7f76e00d0a70 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.947+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e0151a80 con 0x7f76e00d0a70 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.947+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e015a0c0 con 0x7f76e00d0a70 2024-05-14T15:21:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.948+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76e015a780 con 0x7f76e00d0a70 2024-05-14T15:21:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.950+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f76d800aa20 con 0x7f76e00d0a70 2024-05-14T15:21:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76d7e00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f76c00762d0 0x7f76c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f76d80968e0 con 0x7f76e00d0a70 2024-05-14T15:21:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76d7e00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f76c007c7c0 0x7f76c007ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 --> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76c007f320 con 0x7f76c007c7c0 2024-05-14T15:21:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f76d809b2a0 con 0x7f76e00d0a70 2024-05-14T15:21:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76df400640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f76c007c7c0 0x7f76c007ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.951+0000 7f76dfe00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f76c00762d0 0x7f76c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.952+0000 7f76df400640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f76c007c7c0 0x7f76c007ec50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.953+0000 7f76dfe00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f76c00762d0 0x7f76c00787e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76d0006fd0 tx=0x7f76d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.953+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== osd.0 v2:172.21.15.2:6808/3972517232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76c007f320 con 0x7f76c007c7c0 2024-05-14T15:21:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.967+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 --> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f76e00d0810 con 0x7f76c007c7c0 2024-05-14T15:21:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76d7e00640 1 -- 172.21.15.2:0/3554746803 <== osd.0 v2:172.21.15.2:6808/3972517232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f76e00d0810 con 0x7f76c007c7c0 2024-05-14T15:21:30.968 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:30.968 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:30.968 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f76c007c7c0 msgr2=0x7f76c007ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e6a00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:6808/3972517232,v1:172.21.15.2:6809/3972517232] conn(0x7f76c007c7c0 0x7f76c007ec50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f76c00762d0 msgr2=0x7f76c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e6a00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f76c00762d0 0x7f76c00787e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76d0006fd0 tx=0x7f76d0008040 comp rx=0 tx=0).stop 2024-05-14T15:21:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 msgr2=0x7f76e01f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e6a00640 1 --2- 172.21.15.2:0/3554746803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e00d0a70 0x7f76e01f9f40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c6b0 tx=0x7f76d800cb70 comp rx=0 tx=0).stop 2024-05-14T15:21:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.968+0000 7f76e4a00640 1 -- 172.21.15.2:0/3554746803 reap_dead start 2024-05-14T15:21:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.969+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 shutdown_connections 2024-05-14T15:21:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.969+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 >> 172.21.15.2:0/3554746803 conn(0x7f76e00734e0 msgr2=0x7f76e00b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.969+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 shutdown_connections 2024-05-14T15:21:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:30.969+0000 7f76e6a00640 1 -- 172.21.15.2:0/3554746803 wait complete. 2024-05-14T15:21:30.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-14T15:21:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.278+0000 7fbc97e00640 1 Processor -- start 2024-05-14T15:21:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.278+0000 7fbc97e00640 1 -- start start 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.280+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.280+0000 7fbc97e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc980d08a0 0x7fbc980d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.280+0000 7fbc97e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc980b9120 con 0x7fbc980b6a90 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.280+0000 7fbc97e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fbc980d2500 con 0x7fbc980d08a0 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.280+0000 7fbc97e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98162920 con 0x7fbc980b8d10 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc980d08a0 0x7fbc980d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc980d08a0 0x7fbc980d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45052/0 (socket says 172.21.15.2:45052) 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 -- 172.21.15.2:0/3543215343 learned_addr learned my addr 172.21.15.2:0/3543215343 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc96a00640 1 --2- 172.21.15.2:0/3543215343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 -- 172.21.15.2:0/3543215343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 msgr2=0x7fbc981619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 --2- 172.21.15.2:0/3543215343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 -- 172.21.15.2:0/3543215343 >> v1:172.21.15.156:6789/0 conn(0x7fbc980b6a90 legacy=0x7fbc980d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.281+0000 7fbc97400640 1 -- 172.21.15.2:0/3543215343 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc98162360 con 0x7fbc980d08a0 2024-05-14T15:21:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.282+0000 7fbc97400640 1 --2- 172.21.15.2:0/3543215343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980d08a0 0x7fbc980d2990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009870 tx=0x7fbc9002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf251d869f13537 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc96000640 1 -- 172.21.15.2:0/3543215343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90037070 con 0x7fbc980d08a0 2024-05-14T15:21:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc96000640 1 -- 172.21.15.2:0/3543215343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc90032440 con 0x7fbc980d08a0 2024-05-14T15:21:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc96000640 1 -- 172.21.15.2:0/3543215343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90032810 con 0x7fbc980d08a0 2024-05-14T15:21:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc97e00640 1 -- 172.21.15.2:0/3543215343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980d08a0 msgr2=0x7fbc980d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc97e00640 1 --2- 172.21.15.2:0/3543215343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980d08a0 0x7fbc980d2990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009870 tx=0x7fbc9002a130 comp rx=0 tx=0).stop 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc97e00640 1 -- 172.21.15.2:0/3543215343 shutdown_connections 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc97e00640 1 --2- 172.21.15.2:0/3543215343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980d08a0 0x7fbc980d2990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc97e00640 1 --2- 172.21.15.2:0/3543215343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.283+0000 7fbc97e00640 1 -- 172.21.15.2:0/3543215343 >> 172.21.15.2:0/3543215343 conn(0x7fbc980b52e0 msgr2=0x7fbc980b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.284+0000 7fbc97e00640 1 -- 172.21.15.2:0/3543215343 shutdown_connections 2024-05-14T15:21:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.284+0000 7fbc97e00640 1 -- 172.21.15.2:0/3543215343 wait complete. 2024-05-14T15:21:31.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.286+0000 7fbc97e00640 1 Processor -- start 2024-05-14T15:21:31.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.286+0000 7fbc97e00640 1 -- start start 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 0x7fbc9814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc980d08a0 0x7fbc981495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98161f30 con 0x7fbc980b6a90 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980d2190 con 0x7fbc980d08a0 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbc981620b0 con 0x7fbc980b8d10 2024-05-14T15:21:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 0x7fbc9814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 0x7fbc9814ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45062/0 (socket says 172.21.15.2:45062) 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 -- 172.21.15.2:0/1689288611 learned_addr learned my addr 172.21.15.2:0/1689288611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc97400640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc980d08a0 0x7fbc981495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 -- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 msgr2=0x7fbc981f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 -- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc980d08a0 msgr2=0x7fbc981495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc980d08a0 0x7fbc981495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc96a00640 1 -- 172.21.15.2:0/1689288611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc981f8a20 con 0x7fbc980b6a90 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.288+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.289+0000 7fbc96a00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 0x7fbc9814ba50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbc88007e40 tx=0x7fbc8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.289+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88014620 con 0x7fbc980b6a90 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.289+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88019070 con 0x7fbc980b6a90 2024-05-14T15:21:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.289+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc980cadc0 con 0x7fbc980b6a90 2024-05-14T15:21:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.289+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88014a00 con 0x7fbc980b6a90 2024-05-14T15:21:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.289+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc980cb380 con 0x7fbc980b6a90 2024-05-14T15:21:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.290+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc98050870 con 0x7fbc980b6a90 2024-05-14T15:21:31.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.292+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbc88014ba0 con 0x7fbc980b6a90 2024-05-14T15:21:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.293+0000 7fbc8f400640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc74076300 0x7fbc74078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.293+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fbc88097db0 con 0x7fbc980b6a90 2024-05-14T15:21:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.294+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc74076300 0x7fbc74078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.295+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc74076300 0x7fbc74078810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc980b2640 tx=0x7fbc80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.298+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbc8809c070 con 0x7fbc980b6a90 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.508+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbc98069160 con 0x7fbc74076300 2024-05-14T15:21:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.510+0000 7fbc8f400640 1 -- 172.21.15.2:0/1689288611 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbc98069160 con 0x7fbc74076300 2024-05-14T15:21:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-05-14T15:21:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc74076300 msgr2=0x7fbc74078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc74076300 0x7fbc74078810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc980b2640 tx=0x7fbc80008040 comp rx=0 tx=0).stop 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 msgr2=0x7fbc9814ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 0x7fbc9814ba50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbc88007e40 tx=0x7fbc8800e4b0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 shutdown_connections 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbc74076300 0x7fbc74078810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc980d08a0 0x7fbc981495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc980b8d10 0x7fbc981f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 --2- 172.21.15.2:0/1689288611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980b6a90 0x7fbc9814ba50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.512+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 >> 172.21.15.2:0/1689288611 conn(0x7fbc980b52e0 msgr2=0x7fbc980b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.513+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 shutdown_connections 2024-05-14T15:21:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.513+0000 7fbc97e00640 1 -- 172.21.15.2:0/1689288611 wait complete. 2024-05-14T15:21:31.541 INFO:tasks.ceph:Scrubbing osd.1 2024-05-14T15:21:31.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.824+0000 7fc892e00640 1 Processor -- start 2024-05-14T15:21:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.824+0000 7fc892e00640 1 -- start start 2024-05-14T15:21:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.826+0000 7fc892e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc88c160160 0x7fc88c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.826+0000 7fc892e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0b96a0 con 0x7fc88c0d0e50 2024-05-14T15:21:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.826+0000 7fc892e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0d1260 con 0x7fc88c0cc5e0 2024-05-14T15:21:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.826+0000 7fc892e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c160570 con 0x7fc88c160160 2024-05-14T15:21:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.826+0000 7fc892400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc88c0d0e50 0x7fc88c06d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34610/0 (socket says 172.21.15.2:34610) 2024-05-14T15:21:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.826+0000 7fc892400640 1 -- 172.21.15.2:0/1520391575 learned_addr learned my addr 172.21.15.2:0/1520391575 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc891000640 1 --2- 172.21.15.2:0/1520391575 >> v2:172.21.15.156:3300/0 conn(0x7fc88c160160 0x7fc88c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077061451 0 0) 0x7fc884001110 con 0x7fc88c0d0e50 2024-05-14T15:21:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc870003520 con 0x7fc88c0d0e50 2024-05-14T15:21:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2075008756 0 0) 0x7fc870003520 con 0x7fc88c0d0e50 2024-05-14T15:21:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 >> v2:172.21.15.156:3300/0 conn(0x7fc88c160160 msgr2=0x7fc88c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 --2- 172.21.15.2:0/1520391575 >> v2:172.21.15.156:3300/0 conn(0x7fc88c160160 0x7fc88c0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 >> v1:172.21.15.156:6789/0 conn(0x7fc88c0cc5e0 legacy=0x7fc88c0b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c0d4750 con 0x7fc88c0d0e50 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fc8840018c0 con 0x7fc88c0d0e50 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 >> v1:172.21.15.2:6789/0 conn(0x7fc88c0d0e50 legacy=0x7fc88c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc870003aa0 0x7fc870003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870004800 0x7fc870004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8700053f0 0x7fc87000bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c160570 con 0x7fc870003aa0 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000c390 con 0x7fc870004800 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc87000c590 con 0x7fc8700053f0 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.827+0000 7fc891a00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc870003aa0 0x7fc870003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc891000640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870004800 0x7fc870004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc891a00640 1 -- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8700053f0 msgr2=0x7fc87000bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc891a00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8700053f0 0x7fc87000bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc891a00640 1 -- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870004800 msgr2=0x7fc870004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc891a00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870004800 0x7fc870004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc891a00640 1 -- 172.21.15.2:0/1520391575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc870003520 con 0x7fc870003aa0 2024-05-14T15:21:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.828+0000 7fc892400640 1 -- 172.21.15.2:0/1520391575 reap_dead start 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.829+0000 7fc891a00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc870003aa0 0x7fc870003f10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc87c001760 tx=0x7fc870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0d6b82d7e89227 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.829+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0013b0 con 0x7fc870003aa0 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.829+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c0052d0 con 0x7fc870003aa0 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.829+0000 7fc88be00640 1 -- 172.21.15.2:0/1520391575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c02aa50 con 0x7fc870003aa0 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 -- 172.21.15.2:0/1520391575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc870003aa0 msgr2=0x7fc870003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc870003aa0 0x7fc870003f10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc87c001760 tx=0x7fc870005830 comp rx=0 tx=0).stop 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 -- 172.21.15.2:0/1520391575 shutdown_connections 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 --2- 172.21.15.2:0/1520391575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc870003aa0 0x7fc870003f10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 -- 172.21.15.2:0/1520391575 >> 172.21.15.2:0/1520391575 conn(0x7fc88c0d5ff0 msgr2=0x7fc88c0d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 -- 172.21.15.2:0/1520391575 shutdown_connections 2024-05-14T15:21:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.830+0000 7fc892e00640 1 -- 172.21.15.2:0/1520391575 wait complete. 2024-05-14T15:21:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.832+0000 7fc892e00640 1 Processor -- start 2024-05-14T15:21:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.833+0000 7fc892e00640 1 -- start start 2024-05-14T15:21:31.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc892e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870003aa0 0x7fc88c1f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc892e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc88c14ee70 0x7fc88c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc892e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc88c0ce870 0x7fc88c161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc892e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c06ca70 con 0x7fc88c14ee70 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc892e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c06c790 con 0x7fc870003aa0 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc892e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c06cd50 con 0x7fc88c0ce870 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc891000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc88c14ee70 0x7fc88c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc891000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc88c14ee70 0x7fc88c0ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45068/0 (socket says 172.21.15.2:45068) 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.834+0000 7fc891000640 1 -- 172.21.15.2:0/814494134 learned_addr learned my addr 172.21.15.2:0/814494134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc892400640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc88c0ce870 0x7fc88c161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891a00640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870003aa0 0x7fc88c1f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891000640 1 -- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc88c0ce870 msgr2=0x7fc88c161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891000640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc88c0ce870 0x7fc88c161090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891000640 1 -- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870003aa0 msgr2=0x7fc88c1f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891000640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc870003aa0 0x7fc88c1f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891000640 1 -- 172.21.15.2:0/814494134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c0cec80 con 0x7fc88c14ee70 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc891000640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc88c14ee70 0x7fc88c0ce330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc878009ce0 tx=0x7fc878007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878014610 con 0x7fc88c14ee70 2024-05-14T15:21:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc878019070 con 0x7fc88c14ee70 2024-05-14T15:21:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780149f0 con 0x7fc88c14ee70 2024-05-14T15:21:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c1fa640 con 0x7fc88c14ee70 2024-05-14T15:21:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.835+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c160890 con 0x7fc88c14ee70 2024-05-14T15:21:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.836+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc88c1fab60 con 0x7fc88c14ee70 2024-05-14T15:21:31.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.838+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc878014b90 con 0x7fc88c14ee70 2024-05-14T15:21:31.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc889600640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc86c076300 0x7fc86c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fc878097e90 con 0x7fc88c14ee70 2024-05-14T15:21:31.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc889600640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7fc86c07c7f0 0x7fc86c07ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 --> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc86c07f350 con 0x7fc86c07c7f0 2024-05-14T15:21:31.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fc87809a4b0 con 0x7fc88c14ee70 2024-05-14T15:21:31.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc892400640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7fc86c07c7f0 0x7fc86c07ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.839+0000 7fc891a00640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc86c076300 0x7fc86c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.840+0000 7fc892400640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7fc86c07c7f0 0x7fc86c07ec80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.841+0000 7fc891a00640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc86c076300 0x7fc86c078810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc87c032000 tx=0x7fc87c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.841+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== osd.1 v2:172.21.15.2:6820/709711277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc86c07f350 con 0x7fc86c07c7f0 2024-05-14T15:21:31.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.856+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 --> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc88c1fa3f0 con 0x7fc86c07c7f0 2024-05-14T15:21:31.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.856+0000 7fc889600640 1 -- 172.21.15.2:0/814494134 <== osd.1 v2:172.21.15.2:6820/709711277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc88c1fa3f0 con 0x7fc86c07c7f0 2024-05-14T15:21:31.856 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:31.856 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:31.856 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:31.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7fc86c07c7f0 msgr2=0x7fc86c07ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:6820/709711277,v1:172.21.15.2:6822/709711277] conn(0x7fc86c07c7f0 0x7fc86c07ec80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc86c076300 msgr2=0x7fc86c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc86c076300 0x7fc86c078810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc87c032000 tx=0x7fc87c02e000 comp rx=0 tx=0).stop 2024-05-14T15:21:31.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc88c14ee70 msgr2=0x7fc88c0ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 --2- 172.21.15.2:0/814494134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc88c14ee70 0x7fc88c0ce330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc878009ce0 tx=0x7fc878007700 comp rx=0 tx=0).stop 2024-05-14T15:21:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892400640 1 -- 172.21.15.2:0/814494134 reap_dead start 2024-05-14T15:21:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 shutdown_connections 2024-05-14T15:21:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 >> 172.21.15.2:0/814494134 conn(0x7fc88c0d5ff0 msgr2=0x7fc88c06e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 shutdown_connections 2024-05-14T15:21:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:31.857+0000 7fc892e00640 1 -- 172.21.15.2:0/814494134 wait complete. 2024-05-14T15:21:31.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-14T15:21:32.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.160+0000 7f4bca400640 1 Processor -- start 2024-05-14T15:21:32.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.160+0000 7f4bca400640 1 -- start start 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.162+0000 7f4bca400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4bc415c800 0x7f4bc4160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bca400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 0x7f4bc41606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bca400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc40ae7c0 con 0x7f4bc4160be0 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bca400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc4160ff0 con 0x7f4bc415c800 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bca400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc40b4fc0 con 0x7f4bc40b0eb0 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bc3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4bc4160be0 0x7f4bc406c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34616/0 (socket says 172.21.15.2:34616) 2024-05-14T15:21:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bc3e00640 1 -- 172.21.15.2:0/3398719581 learned_addr learned my addr 172.21.15.2:0/3398719581 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bc3400640 1 --2- 172.21.15.2:0/3398719581 >> v2:172.21.15.156:3300/0 conn(0x7f4bc415c800 0x7f4bc4160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.163+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 0x7f4bc41606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238070975 0 0) 0x7f4bbc001490 con 0x7f4bc4160be0 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba8005730 con 0x7f4bc4160be0 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4083975467 0 0) 0x7f4ba8005730 con 0x7f4bc4160be0 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 msgr2=0x7f4bc41606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 0x7f4bc41606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 >> v2:172.21.15.156:3300/0 conn(0x7f4bc415c800 msgr2=0x7f4bc4160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 --2- 172.21.15.2:0/3398719581 >> v2:172.21.15.156:3300/0 conn(0x7f4bc415c800 0x7f4bc4160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc40b6b00 con 0x7f4bc4160be0 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f4bbc001c40 con 0x7f4bc4160be0 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 >> v1:172.21.15.2:6789/0 conn(0x7f4bc4160be0 legacy=0x7f4bc406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8005c10 0x7f4ba8006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba8006a10 0x7f4ba8006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 0x7f4ba8007380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4160ff0 con 0x7f4ba8006a10 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.164+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba800dc80 con 0x7f4ba8005c10 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba800de80 con 0x7f4bc40b0eb0 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba8006a10 0x7f4ba8006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc3e00640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 0x7f4ba8007380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc3400640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8005c10 0x7f4ba8006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2a00640 1 -- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 msgr2=0x7f4ba8007380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40b0eb0 0x7f4ba8007380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2a00640 1 -- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8005c10 msgr2=0x7f4ba8006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8005c10 0x7f4ba8006080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.165+0000 7f4bc2a00640 1 -- 172.21.15.2:0/3398719581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba8005730 con 0x7f4ba8006a10 2024-05-14T15:21:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.166+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba8006a10 0x7f4ba8006e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009ac0 tx=0x7f4ba8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addde5924ea11362 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.167+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0036070 con 0x7f4ba8006a10 2024-05-14T15:21:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.167+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0031400 con 0x7f4ba8006a10 2024-05-14T15:21:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.167+0000 7f4bc2000640 1 -- 172.21.15.2:0/3398719581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0009690 con 0x7f4ba8006a10 2024-05-14T15:21:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.167+0000 7f4bca400640 1 -- 172.21.15.2:0/3398719581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba8006a10 msgr2=0x7f4ba8006e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.167+0000 7f4bca400640 1 --2- 172.21.15.2:0/3398719581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba8006a10 0x7f4ba8006e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009ac0 tx=0x7f4ba8007a40 comp rx=0 tx=0).stop 2024-05-14T15:21:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.167+0000 7f4bc3e00640 1 -- 172.21.15.2:0/3398719581 reap_dead start 2024-05-14T15:21:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.168+0000 7f4bca400640 1 -- 172.21.15.2:0/3398719581 shutdown_connections 2024-05-14T15:21:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.168+0000 7f4bca400640 1 -- 172.21.15.2:0/3398719581 >> 172.21.15.2:0/3398719581 conn(0x7f4bc40ce230 msgr2=0x7f4bc40ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.168+0000 7f4bca400640 1 -- 172.21.15.2:0/3398719581 shutdown_connections 2024-05-14T15:21:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.168+0000 7f4bca400640 1 -- 172.21.15.2:0/3398719581 wait complete. 2024-05-14T15:21:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.170+0000 7f4bca400640 1 Processor -- start 2024-05-14T15:21:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.170+0000 7f4bca400640 1 -- start start 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bca400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8006a10 0x7f4bc409c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bca400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 0x7f4bc40cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bca400640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40cb340 0x7f4bc409dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bca400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc40b5560 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bca400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc406fcb0 con 0x7f4ba8006a10 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bca400640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc406f9d0 con 0x7f4bc40cb340 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bc2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 0x7f4bc40cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bc2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 0x7f4bc40cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45074/0 (socket says 172.21.15.2:45074) 2024-05-14T15:21:32.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.172+0000 7f4bc2a00640 1 -- 172.21.15.2:0/1686327350 learned_addr learned my addr 172.21.15.2:0/1686327350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc3400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8006a10 0x7f4bc409c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc3e00640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40cb340 0x7f4bc409dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc2a00640 1 -- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40cb340 msgr2=0x7f4bc409dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40cb340 0x7f4bc409dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc2a00640 1 -- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8006a10 msgr2=0x7f4bc409c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8006a10 0x7f4bc409c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc2a00640 1 -- 172.21.15.2:0/1686327350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc409b5b0 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bc2a00640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 0x7f4bc40cae00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0034040 tx=0x7f4bb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.173+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0040020 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.174+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0003bc0 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.174+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0036040 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.174+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc409b890 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.174+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc409be50 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.175+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc4050870 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.176+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4bb0043020 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.177+0000 7f4bbb400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ba40762d0 0x7f4ba40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.178+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f4bb00b7560 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.178+0000 7f4bc3400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ba40762d0 0x7f4ba40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.180+0000 7f4bc3400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ba40762d0 0x7f4ba40787e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40723e0 tx=0x7f4bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.182+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4bb004a070 con 0x7f4bc40cd3f0 2024-05-14T15:21:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.395+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4bc4068ba0 con 0x7f4ba40762d0 2024-05-14T15:21:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.396+0000 7f4bbb400640 1 -- 172.21.15.2:0/1686327350 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4bc4068ba0 con 0x7f4ba40762d0 2024-05-14T15:21:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-05-14T15:21:32.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ba40762d0 msgr2=0x7f4ba40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ba40762d0 0x7f4ba40787e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40723e0 tx=0x7f4bb4008040 comp rx=0 tx=0).stop 2024-05-14T15:21:32.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 msgr2=0x7f4bc40cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 0x7f4bc40cae00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0034040 tx=0x7f4bb0004730 comp rx=0 tx=0).stop 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 shutdown_connections 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f4ba40762d0 0x7f4ba40787e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc40cb340 0x7f4bc409dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc40cd3f0 0x7f4bc40cae00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 --2- 172.21.15.2:0/1686327350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba8006a10 0x7f4bc409c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 >> 172.21.15.2:0/1686327350 conn(0x7f4bc40ce230 msgr2=0x7f4bc415bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 shutdown_connections 2024-05-14T15:21:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.399+0000 7f4bca400640 1 -- 172.21.15.2:0/1686327350 wait complete. 2024-05-14T15:21:32.423 INFO:tasks.ceph:Scrubbing osd.2 2024-05-14T15:21:32.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.717+0000 7fc615200640 1 Processor -- start 2024-05-14T15:21:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.717+0000 7fc615200640 1 -- start start 2024-05-14T15:21:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.719+0000 7fc615200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 0x7fc6100d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.719+0000 7fc615200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc610161db0 con 0x7fc61006de10 2024-05-14T15:21:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.719+0000 7fc615200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc610162090 con 0x7fc61009f570 2024-05-14T15:21:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.720+0000 7fc615200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc610161b60 con 0x7fc6100af620 2024-05-14T15:21:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.720+0000 7fc60d400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc61006de10 0x7fc6100cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34622/0 (socket says 172.21.15.2:34622) 2024-05-14T15:21:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.720+0000 7fc60d400640 1 -- 172.21.15.2:0/866574638 learned_addr learned my addr 172.21.15.2:0/866574638 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.720+0000 7fc60e800640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 0x7fc6100d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.720+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423306901 0 0) 0x7fc610161db0 con 0x7fc61006de10 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.720+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5f4003520 con 0x7fc61006de10 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798287416 0 0) 0x7fc5f4003520 con 0x7fc61006de10 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 msgr2=0x7fc6100d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 0x7fc6100d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 >> v1:172.21.15.156:6789/0 conn(0x7fc61009f570 legacy=0x7fc61006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc610162370 con 0x7fc61006de10 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fc5fc0016f0 con 0x7fc61006de10 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 >> v1:172.21.15.2:6789/0 conn(0x7fc61006de10 legacy=0x7fc6100cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4003a80 0x7fc5f4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 0x7fc5f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f4004d90 0x7fc5f4005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc610161b60 con 0x7fc5f4004d90 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f400bbd0 con 0x7fc5f4003a80 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f400bdd0 con 0x7fc6100af620 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.721+0000 7fc60e800640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f4004d90 0x7fc5f4005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60de00640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4003a80 0x7fc5f4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60d400640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 0x7fc5f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60e800640 1 -- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 msgr2=0x7fc5f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60e800640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6100af620 0x7fc5f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60e800640 1 -- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4003a80 msgr2=0x7fc5f4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60e800640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4003a80 0x7fc5f4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60e800640 1 -- 172.21.15.2:0/866574638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f4003520 con 0x7fc5f4004d90 2024-05-14T15:21:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.722+0000 7fc60de00640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4003a80 0x7fc5f4003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:32.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.723+0000 7fc60e800640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f4004d90 0x7fc5f4005240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc608009f90 tx=0x7fc5f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177d486766443e2a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608009c10 con 0x7fc5f4004d90 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc608036070 con 0x7fc5f4004d90 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc60ca00640 1 -- 172.21.15.2:0/866574638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608031850 con 0x7fc5f4004d90 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc615200640 1 -- 172.21.15.2:0/866574638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f4004d90 msgr2=0x7fc5f4005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc615200640 1 --2- 172.21.15.2:0/866574638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f4004d90 0x7fc5f4005240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc608009f90 tx=0x7fc5f4005830 comp rx=0 tx=0).stop 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc60e800640 1 -- 172.21.15.2:0/866574638 reap_dead start 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc615200640 1 -- 172.21.15.2:0/866574638 shutdown_connections 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.724+0000 7fc615200640 1 -- 172.21.15.2:0/866574638 >> 172.21.15.2:0/866574638 conn(0x7fc6100734e0 msgr2=0x7fc6100738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.725+0000 7fc615200640 1 -- 172.21.15.2:0/866574638 shutdown_connections 2024-05-14T15:21:32.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.725+0000 7fc615200640 1 -- 172.21.15.2:0/866574638 wait complete. 2024-05-14T15:21:32.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.727+0000 7fc615200640 1 Processor -- start 2024-05-14T15:21:32.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.727+0000 7fc615200640 1 -- start start 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc615200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4004d90 0x7fc61015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc615200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc610157950 0x7fc6101460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc615200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6100cbf40 0x7fc6100cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc615200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6100d0bf0 con 0x7fc6100cbf40 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc615200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc6100d0a70 con 0x7fc5f4004d90 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc615200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc6100d0d70 con 0x7fc610157950 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc60e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6100cbf40 0x7fc6100cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc60e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6100cbf40 0x7fc6100cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45102/0 (socket says 172.21.15.2:45102) 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc60e800640 1 -- 172.21.15.2:0/3761503127 learned_addr learned my addr 172.21.15.2:0/3761503127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:32.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc60de00640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4004d90 0x7fc61015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc60e800640 1 -- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc610157950 msgr2=0x7fc6101460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.729+0000 7fc60e800640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc610157950 0x7fc6101460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc60e800640 1 -- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4004d90 msgr2=0x7fc61015ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc60e800640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4004d90 0x7fc61015ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc60e800640 1 -- 172.21.15.2:0/3761503127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6100caea0 con 0x7fc6100cbf40 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc60de00640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f4004d90 0x7fc61015ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:32.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc60e800640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6100cbf40 0x7fc6100cc350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc608033040 tx=0x7fc608009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608009c10 con 0x7fc6100cbf40 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc608003990 con 0x7fc6100cbf40 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6100cb180 con 0x7fc6100cbf40 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608003d80 con 0x7fc6100cbf40 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.730+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6100cb740 con 0x7fc6100cbf40 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.731+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc610050870 con 0x7fc6100cbf40 2024-05-14T15:21:32.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.733+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc608005d10 con 0x7fc6100cbf40 2024-05-14T15:21:32.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.734+0000 7fc606000640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc5f0076300 0x7fc5f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.734+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fc6080b8ed0 con 0x7fc6100cbf40 2024-05-14T15:21:32.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.734+0000 7fc606000640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fc5f007c7f0 0x7fc5f007ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:32.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.734+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 --> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc608001e80 con 0x7fc5f007c7f0 2024-05-14T15:21:32.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.734+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fc6080b9280 con 0x7fc6100cbf40 2024-05-14T15:21:32.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.735+0000 7fc60d400640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fc5f007c7f0 0x7fc5f007ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.735+0000 7fc60de00640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc5f0076300 0x7fc5f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:32.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.735+0000 7fc60d400640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fc5f007c7f0 0x7fc5f007ec80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.736+0000 7fc60de00640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc5f0076300 0x7fc5f0078810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc600001750 tx=0x7fc600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:32.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.736+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== osd.2 v2:172.21.15.2:6815/216526144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc608001e80 con 0x7fc5f007c7f0 2024-05-14T15:21:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.751+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 --> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc61015d040 con 0x7fc5f007c7f0 2024-05-14T15:21:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc606000640 1 -- 172.21.15.2:0/3761503127 <== osd.2 v2:172.21.15.2:6815/216526144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc61015d040 con 0x7fc5f007c7f0 2024-05-14T15:21:32.752 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:32.752 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:32.752 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fc5f007c7f0 msgr2=0x7fc5f007ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc615200640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:6815/216526144,v1:172.21.15.2:6817/216526144] conn(0x7fc5f007c7f0 0x7fc5f007ec80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc5f0076300 msgr2=0x7fc5f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc615200640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc5f0076300 0x7fc5f0078810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc600001750 tx=0x7fc600009040 comp rx=0 tx=0).stop 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6100cbf40 msgr2=0x7fc6100cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.752+0000 7fc615200640 1 --2- 172.21.15.2:0/3761503127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6100cbf40 0x7fc6100cc350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc608033040 tx=0x7fc608009750 comp rx=0 tx=0).stop 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.753+0000 7fc60e800640 1 -- 172.21.15.2:0/3761503127 reap_dead start 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.753+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 shutdown_connections 2024-05-14T15:21:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.753+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 >> 172.21.15.2:0/3761503127 conn(0x7fc6100734e0 msgr2=0x7fc61006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.753+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 shutdown_connections 2024-05-14T15:21:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:32.753+0000 7fc615200640 1 -- 172.21.15.2:0/3761503127 wait complete. 2024-05-14T15:21:32.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-14T15:21:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.063+0000 7fa1a4a00640 1 Processor -- start 2024-05-14T15:21:33.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.064+0000 7fa1a4a00640 1 -- start start 2024-05-14T15:21:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.066+0000 7fa1a4a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1a0149290 0x7fa1a00b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.066+0000 7fa1a4a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a0070b70 con 0x7fa1a0070760 2024-05-14T15:21:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.066+0000 7fa1a4a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a00aeac0 con 0x7fa1a00b08f0 2024-05-14T15:21:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.066+0000 7fa1a4a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a00aeda0 con 0x7fa1a0149290 2024-05-14T15:21:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.067+0000 7fa19ea00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa1a0070760 0x7fa1a00b01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34632/0 (socket says 172.21.15.2:34632) 2024-05-14T15:21:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.067+0000 7fa19ea00640 1 -- 172.21.15.2:0/127490781 learned_addr learned my addr 172.21.15.2:0/127490781 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.067+0000 7fa19f400640 1 --2- 172.21.15.2:0/127490781 >> v2:172.21.15.156:3300/0 conn(0x7fa1a0149290 0x7fa1a00b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.067+0000 7fa19e000640 1 -- 172.21.15.2:0/127490781 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937838837 0 0) 0x7fa1a0070b70 con 0x7fa1a0070760 2024-05-14T15:21:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.067+0000 7fa19e000640 1 -- 172.21.15.2:0/127490781 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa184003520 con 0x7fa1a0070760 2024-05-14T15:21:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.068+0000 7fa19f400640 1 -- 172.21.15.2:0/127490781 >> v1:172.21.15.156:6789/0 conn(0x7fa1a00b08f0 legacy=0x7fa1a00b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.068+0000 7fa19e000640 1 -- 172.21.15.2:0/127490781 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1376115638 0 0) 0x7fa184003520 con 0x7fa1a0070760 2024-05-14T15:21:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.068+0000 7fa19f400640 1 -- 172.21.15.2:0/127490781 >> v1:172.21.15.2:6789/0 conn(0x7fa1a0070760 legacy=0x7fa1a00b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.068+0000 7fa19f400640 1 -- 172.21.15.2:0/127490781 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a006fc80 con 0x7fa1a0149290 2024-05-14T15:21:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.070+0000 7fa19f400640 1 --2- 172.21.15.2:0/127490781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a0149290 0x7fa1a00b4670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa190009d90 tx=0x7fa19002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a135936e03f09a59 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.070+0000 7fa19e000640 1 -- 172.21.15.2:0/127490781 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0016f0 con 0x7fa1a0149290 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.070+0000 7fa19e000640 1 -- 172.21.15.2:0/127490781 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190007540 con 0x7fa1a0149290 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.070+0000 7fa19e000640 1 -- 172.21.15.2:0/127490781 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900078f0 con 0x7fa1a0149290 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 -- 172.21.15.2:0/127490781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a0149290 msgr2=0x7fa1a00b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/127490781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a0149290 0x7fa1a00b4670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa190009d90 tx=0x7fa19002a680 comp rx=0 tx=0).stop 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 -- 172.21.15.2:0/127490781 shutdown_connections 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/127490781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a0149290 0x7fa1a00b4670 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 -- 172.21.15.2:0/127490781 >> 172.21.15.2:0/127490781 conn(0x7fa1a00739a0 msgr2=0x7fa1a0073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 -- 172.21.15.2:0/127490781 shutdown_connections 2024-05-14T15:21:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.071+0000 7fa1a4a00640 1 -- 172.21.15.2:0/127490781 wait complete. 2024-05-14T15:21:33.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.074+0000 7fa1a4a00640 1 Processor -- start 2024-05-14T15:21:33.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.074+0000 7fa1a4a00640 1 -- start start 2024-05-14T15:21:33.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.075+0000 7fa1a4a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1a0070760 0x7fa1a015f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.075+0000 7fa1a4a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a00b08f0 0x7fa1a0161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.075+0000 7fa1a4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 0x7fa1a0161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.075+0000 7fa1a4a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a00ae750 con 0x7fa1a0149290 2024-05-14T15:21:33.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.075+0000 7fa1a4a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0070240 con 0x7fa1a00b08f0 2024-05-14T15:21:33.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.075+0000 7fa1a4a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a0146270 con 0x7fa1a0070760 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 0x7fa1a0161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 0x7fa1a0161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45110/0 (socket says 172.21.15.2:45110) 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 -- 172.21.15.2:0/2993559428 learned_addr learned my addr 172.21.15.2:0/2993559428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19f400640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1a0070760 0x7fa1a015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19ea00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a00b08f0 0x7fa1a0161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 -- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1a0070760 msgr2=0x7fa1a015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1a0070760 0x7fa1a015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 -- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a00b08f0 msgr2=0x7fa1a0161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a00b08f0 0x7fa1a0161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.076+0000 7fa19fe00640 1 -- 172.21.15.2:0/2993559428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a01624a0 con 0x7fa1a0149290 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.077+0000 7fa19fe00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 0x7fa1a0161c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa19800c3f0 tx=0x7fa19800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.077+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198017070 con 0x7fa1a0149290 2024-05-14T15:21:33.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.077+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1980052d0 con 0x7fa1a0149290 2024-05-14T15:21:33.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.077+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a0162780 con 0x7fa1a0149290 2024-05-14T15:21:33.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.077+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198003810 con 0x7fa1a0149290 2024-05-14T15:21:33.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.077+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a0162d40 con 0x7fa1a0149290 2024-05-14T15:21:33.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.078+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a0162210 con 0x7fa1a0149290 2024-05-14T15:21:33.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.080+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa19801a070 con 0x7fa1a0149290 2024-05-14T15:21:33.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.081+0000 7fa197400640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1800762d0 0x7fa1800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.082+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fa198096880 con 0x7fa1a0149290 2024-05-14T15:21:33.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.082+0000 7fa19f400640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1800762d0 0x7fa1800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.083+0000 7fa19f400640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1800762d0 0x7fa1800787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa190034000 tx=0x7fa19002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.087+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1980602c0 con 0x7fa1a0149290 2024-05-14T15:21:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.297+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa1a0050870 con 0x7fa1800762d0 2024-05-14T15:21:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.299+0000 7fa197400640 1 -- 172.21.15.2:0/2993559428 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa1a0050870 con 0x7fa1800762d0 2024-05-14T15:21:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-05-14T15:21:33.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1800762d0 msgr2=0x7fa1800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1800762d0 0x7fa1800787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa190034000 tx=0x7fa19002f000 comp rx=0 tx=0).stop 2024-05-14T15:21:33.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 msgr2=0x7fa1a0161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 0x7fa1a0161c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa19800c3f0 tx=0x7fa19800c8b0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 shutdown_connections 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa1800762d0 0x7fa1800787e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1a00b08f0 0x7fa1a0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0149290 0x7fa1a0161c40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 --2- 172.21.15.2:0/2993559428 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1a0070760 0x7fa1a015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.301+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 >> 172.21.15.2:0/2993559428 conn(0x7fa1a00739a0 msgr2=0x7fa1a0144640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:33.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.302+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 shutdown_connections 2024-05-14T15:21:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.302+0000 7fa1a4a00640 1 -- 172.21.15.2:0/2993559428 wait complete. 2024-05-14T15:21:33.330 INFO:tasks.ceph:Scrubbing osd.3 2024-05-14T15:21:33.331 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:33.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.622+0000 7fbce1e00640 1 Processor -- start 2024-05-14T15:21:33.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.623+0000 7fbce1e00640 1 -- start start 2024-05-14T15:21:33.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.625+0000 7fbce1e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbcdc15ea80 0x7fbcdc06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.625+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 0x7fbcdc167f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.625+0000 7fbce1e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcdc1649a0 con 0x7fbcdc168480 2024-05-14T15:21:33.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.625+0000 7fbce1e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fbcdc06e050 con 0x7fbcdc15ea80 2024-05-14T15:21:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.625+0000 7fbce1e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc168ca0 con 0x7fbcdc06dc40 2024-05-14T15:21:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.625+0000 7fbce1400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbcdc168480 0x7fbcdc06f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34648/0 (socket says 172.21.15.2:34648) 2024-05-14T15:21:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbce1400640 1 -- 172.21.15.2:0/2581153412 learned_addr learned my addr 172.21.15.2:0/2581153412 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbce0a00640 1 --2- 172.21.15.2:0/2581153412 >> v2:172.21.15.156:3300/0 conn(0x7fbcdc15ea80 0x7fbcdc06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 0x7fbcdc167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139567565 0 0) 0x7fbcd4001110 con 0x7fbcdc168480 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc0003520 con 0x7fbcdc168480 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 281110200 0 0) 0x7fbcc0003520 con 0x7fbcdc168480 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 msgr2=0x7fbcdc167f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 0x7fbcdc167f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 >> v2:172.21.15.156:3300/0 conn(0x7fbcdc15ea80 msgr2=0x7fbcdc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 --2- 172.21.15.2:0/2581153412 >> v2:172.21.15.156:3300/0 conn(0x7fbcdc15ea80 0x7fbcdc06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.626+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc164c20 con 0x7fbcdc168480 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fbcd40018c0 con 0x7fbcdc168480 2024-05-14T15:21:33.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 >> v1:172.21.15.2:6789/0 conn(0x7fbcdc168480 legacy=0x7fbcdc06f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 0x7fbcc0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcc0003fd0 0x7fbcc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcc0004d40 0x7fbcc0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc06e050 con 0x7fbcc0003fd0 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc168ca0 con 0x7fbcc0004d40 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc000bb50 con 0x7fbcdc06dc40 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcc0003fd0 0x7fbcc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbce0a00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 0x7fbcc0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.627+0000 7fbce1400640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcc0004d40 0x7fbcc0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.628+0000 7fbcdbe00640 1 -- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 msgr2=0x7fbcc0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.628+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc06dc40 0x7fbcc0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.628+0000 7fbcdbe00640 1 -- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcc0004d40 msgr2=0x7fbcc0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.628+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcc0004d40 0x7fbcc0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.628+0000 7fbcdbe00640 1 -- 172.21.15.2:0/2581153412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc0003520 con 0x7fbcc0003fd0 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.629+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcc0003fd0 0x7fbcc0004800 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009a90 tx=0x7fbcc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973f7eeeb65164c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.629+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4036070 con 0x7fbcc0003fd0 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.629+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4031400 con 0x7fbcc0003fd0 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.629+0000 7fbcdb400640 1 -- 172.21.15.2:0/2581153412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4009690 con 0x7fbcc0003fd0 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1e00640 1 -- 172.21.15.2:0/2581153412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcc0003fd0 msgr2=0x7fbcc0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1e00640 1 --2- 172.21.15.2:0/2581153412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcc0003fd0 0x7fbcc0004800 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009a90 tx=0x7fbcc0005830 comp rx=0 tx=0).stop 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1400640 1 -- 172.21.15.2:0/2581153412 reap_dead start 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1e00640 1 -- 172.21.15.2:0/2581153412 shutdown_connections 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1e00640 1 -- 172.21.15.2:0/2581153412 >> 172.21.15.2:0/2581153412 conn(0x7fbcdc0d1b10 msgr2=0x7fbcdc073300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1e00640 1 -- 172.21.15.2:0/2581153412 shutdown_connections 2024-05-14T15:21:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.630+0000 7fbce1e00640 1 -- 172.21.15.2:0/2581153412 wait complete. 2024-05-14T15:21:33.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.632+0000 7fbce1e00640 1 Processor -- start 2024-05-14T15:21:33.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.633+0000 7fbce1e00640 1 -- start start 2024-05-14T15:21:33.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.634+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcc0003fd0 0x7fbcdc1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.634+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc159060 0x7fbcdc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.634+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcdc159470 0x7fbcdc06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.634+0000 7fbce1e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc168a10 con 0x7fbcdc159470 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.634+0000 7fbce1e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc168890 con 0x7fbcdc159060 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.634+0000 7fbce1e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc165700 con 0x7fbcc0003fd0 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcdc159470 0x7fbcdc06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcdc159470 0x7fbcdc06fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45118/0 (socket says 172.21.15.2:45118) 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 -- 172.21.15.2:0/1973245360 learned_addr learned my addr 172.21.15.2:0/1973245360 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce0a00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcc0003fd0 0x7fbcdc1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc159060 0x7fbcdc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 -- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcc0003fd0 msgr2=0x7fbcdc1492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcc0003fd0 0x7fbcdc1492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 -- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc159060 msgr2=0x7fbcdc06f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc159060 0x7fbcdc06f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.635+0000 7fbce1400640 1 -- 172.21.15.2:0/1973245360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc154890 con 0x7fbcdc159470 2024-05-14T15:21:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.636+0000 7fbce1400640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcdc159470 0x7fbcdc06fac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4001eb0 tx=0x7fbcd4007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.636+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4007760 con 0x7fbcdc159470 2024-05-14T15:21:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.636+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd4018070 con 0x7fbcdc159470 2024-05-14T15:21:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.636+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400e870 con 0x7fbcdc159470 2024-05-14T15:21:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.636+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc149bb0 con 0x7fbcdc159470 2024-05-14T15:21:33.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.636+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc159eb0 con 0x7fbcdc159470 2024-05-14T15:21:33.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.637+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcdc154c30 con 0x7fbcdc159470 2024-05-14T15:21:33.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.639+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbcd400ea10 con 0x7fbcdc159470 2024-05-14T15:21:33.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbcd8c00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcb8076470 0x7fbcb8078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fbcd4097af0 con 0x7fbcdc159470 2024-05-14T15:21:33.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbcd8c00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7fbcb807c960 0x7fbcb807edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 --> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcd4007760 con 0x7fbcb807c960 2024-05-14T15:21:33.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fbcd4097ea0 con 0x7fbcdc159470 2024-05-14T15:21:33.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7fbcb807c960 0x7fbcb807edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.640+0000 7fbce0a00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcb8076470 0x7fbcb8078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.641+0000 7fbcdbe00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7fbcb807c960 0x7fbcb807edf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.642+0000 7fbce0a00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcb8076470 0x7fbcb8078980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0cdab0 tx=0x7fbccc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.642+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== osd.3 v2:172.21.15.2:6800/2884583722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcd4007760 con 0x7fbcb807c960 2024-05-14T15:21:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.657+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 --> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcdc159980 con 0x7fbcb807c960 2024-05-14T15:21:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.657+0000 7fbcd8c00640 1 -- 172.21.15.2:0/1973245360 <== osd.3 v2:172.21.15.2:6800/2884583722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbcdc159980 con 0x7fbcb807c960 2024-05-14T15:21:33.657 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:33.658 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:33.658 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.658+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7fbcb807c960 msgr2=0x7fbcb807edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.658+0000 7fbce1e00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:6800/2884583722,v1:172.21.15.2:6801/2884583722] conn(0x7fbcb807c960 0x7fbcb807edf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.658+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcb8076470 msgr2=0x7fbcb8078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.658+0000 7fbce1e00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbcb8076470 0x7fbcb8078980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0cdab0 tx=0x7fbccc00b040 comp rx=0 tx=0).stop 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.658+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcdc159470 msgr2=0x7fbcdc06fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.658+0000 7fbce1e00640 1 --2- 172.21.15.2:0/1973245360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcdc159470 0x7fbcdc06fac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4001eb0 tx=0x7fbcd4007420 comp rx=0 tx=0).stop 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.659+0000 7fbce1400640 1 -- 172.21.15.2:0/1973245360 reap_dead start 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.659+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 shutdown_connections 2024-05-14T15:21:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.659+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 >> 172.21.15.2:0/1973245360 conn(0x7fbcdc0d1b10 msgr2=0x7fbcdc0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.659+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 shutdown_connections 2024-05-14T15:21:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.659+0000 7fbce1e00640 1 -- 172.21.15.2:0/1973245360 wait complete. 2024-05-14T15:21:33.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-14T15:21:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.971+0000 7f30cf200640 1 Processor -- start 2024-05-14T15:21:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.972+0000 7f30cf200640 1 -- start start 2024-05-14T15:21:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.974+0000 7f30cf200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30d0160720 0x7f30d00b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.974+0000 7f30cf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d0160c90 con 0x7f30d00cdd80 2024-05-14T15:21:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.974+0000 7f30cf200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d0160f70 con 0x7f30d015d760 2024-05-14T15:21:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.974+0000 7f30cf200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f30d015ab00 con 0x7f30d0160720 2024-05-14T15:21:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30cde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30d0160720 0x7f30d00b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30c7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f30d00cdd80 0x7f30d00b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34652/0 (socket says 172.21.15.2:34652) 2024-05-14T15:21:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30c7e00640 1 -- 172.21.15.2:0/3381815755 learned_addr learned my addr 172.21.15.2:0/3381815755 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30cde00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30d0160720 0x7f30d00b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45124/0 (socket says 172.21.15.2:45124) 2024-05-14T15:21:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30cde00640 1 -- 172.21.15.2:0/3381815755 >> v1:172.21.15.156:6789/0 conn(0x7f30d015d760 legacy=0x7f30d0070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30cde00640 1 -- 172.21.15.2:0/3381815755 >> v1:172.21.15.2:6789/0 conn(0x7f30d00cdd80 legacy=0x7f30d00b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30cde00640 1 -- 172.21.15.2:0/3381815755 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d0161250 con 0x7f30d0160720 2024-05-14T15:21:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.975+0000 7f30cd400640 1 -- 172.21.15.2:0/3381815755 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861877697 0 0) 0x7f30d0160c90 con 0x7f30d00cdd80 2024-05-14T15:21:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.976+0000 7f30cde00640 1 --2- 172.21.15.2:0/3381815755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d0160720 0x7f30d00b6530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f30c00097a0 tx=0x7f30c002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda049f59631b6ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.977+0000 7f30cd400640 1 -- 172.21.15.2:0/3381815755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0037070 con 0x7f30d0160720 2024-05-14T15:21:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.977+0000 7f30cd400640 1 -- 172.21.15.2:0/3381815755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c002ae50 con 0x7f30d0160720 2024-05-14T15:21:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.977+0000 7f30cd400640 1 -- 172.21.15.2:0/3381815755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0032660 con 0x7f30d0160720 2024-05-14T15:21:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.977+0000 7f30cf200640 1 -- 172.21.15.2:0/3381815755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d0160720 msgr2=0x7f30d00b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.977+0000 7f30cf200640 1 --2- 172.21.15.2:0/3381815755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d0160720 0x7f30d00b6530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f30c00097a0 tx=0x7f30c002a100 comp rx=0 tx=0).stop 2024-05-14T15:21:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.978+0000 7f30cf200640 1 -- 172.21.15.2:0/3381815755 shutdown_connections 2024-05-14T15:21:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.978+0000 7f30cf200640 1 --2- 172.21.15.2:0/3381815755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d0160720 0x7f30d00b6530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.978+0000 7f30cf200640 1 -- 172.21.15.2:0/3381815755 >> 172.21.15.2:0/3381815755 conn(0x7f30d00739a0 msgr2=0x7f30d0073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.978+0000 7f30cf200640 1 -- 172.21.15.2:0/3381815755 shutdown_connections 2024-05-14T15:21:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.978+0000 7f30cf200640 1 -- 172.21.15.2:0/3381815755 wait complete. 2024-05-14T15:21:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.980+0000 7f30cf200640 1 Processor -- start 2024-05-14T15:21:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.980+0000 7f30cf200640 1 -- start start 2024-05-14T15:21:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cf200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00cdd80 0x7f30d014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 0x7f30d00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d0160720 0x7f30d00cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30d00b6a70 con 0x7f30d015d760 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cf200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f30d0161530 con 0x7f30d00cdd80 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f30d00b4d80 con 0x7f30d0160720 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 0x7f30d00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 0x7f30d00ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45140/0 (socket says 172.21.15.2:45140) 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 -- 172.21.15.2:0/1872127495 learned_addr learned my addr 172.21.15.2:0/1872127495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 -- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d0160720 msgr2=0x7f30d00cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30ce800640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d0160720 0x7f30d00cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30cde00640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00cdd80 0x7f30d014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d0160720 0x7f30d00cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 -- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00cdd80 msgr2=0x7f30d014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00cdd80 0x7f30d014fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.982+0000 7f30c7e00640 1 -- 172.21.15.2:0/1872127495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d00cf050 con 0x7f30d015d760 2024-05-14T15:21:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.983+0000 7f30c7e00640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 0x7f30d00ce4e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f30b800c3c0 tx=0x7f30b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.983+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b80074e0 con 0x7f30d015d760 2024-05-14T15:21:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.983+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b80047e0 con 0x7f30d015d760 2024-05-14T15:21:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.983+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d00cf330 con 0x7f30d015d760 2024-05-14T15:21:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.983+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8004bd0 con 0x7f30d015d760 2024-05-14T15:21:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.983+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d00cf8f0 con 0x7f30d015d760 2024-05-14T15:21:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.985+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d00cedc0 con 0x7f30d015d760 2024-05-14T15:21:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.986+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30b8011070 con 0x7f30d015d760 2024-05-14T15:21:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.987+0000 7f30c6000640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f30ac0762d0 0x7f30ac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.987+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f30b80971c0 con 0x7f30d015d760 2024-05-14T15:21:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.988+0000 7f30cde00640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f30ac0762d0 0x7f30ac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.989+0000 7f30cde00640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f30ac0762d0 0x7f30ac0787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f30c0034000 tx=0x7f30c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:33.992+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30b8060b60 con 0x7f30d015d760 2024-05-14T15:21:34.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.203+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f30d0050870 con 0x7f30ac0762d0 2024-05-14T15:21:34.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.204+0000 7f30c6000640 1 -- 172.21.15.2:0/1872127495 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30d0050870 con 0x7f30ac0762d0 2024-05-14T15:21:34.204 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f30ac0762d0 msgr2=0x7f30ac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f30ac0762d0 0x7f30ac0787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f30c0034000 tx=0x7f30c002e000 comp rx=0 tx=0).stop 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 msgr2=0x7f30d00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 0x7f30d00ce4e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f30b800c3c0 tx=0x7f30b800c880 comp rx=0 tx=0).stop 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 shutdown_connections 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f30ac0762d0 0x7f30ac0787e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d0160720 0x7f30d00cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d015d760 0x7f30d00ce4e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.206+0000 7f30cf200640 1 --2- 172.21.15.2:0/1872127495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00cdd80 0x7f30d014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.207+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 >> 172.21.15.2:0/1872127495 conn(0x7f30d00739a0 msgr2=0x7f30d015a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:34.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.207+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 shutdown_connections 2024-05-14T15:21:34.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.207+0000 7f30cf200640 1 -- 172.21.15.2:0/1872127495 wait complete. 2024-05-14T15:21:34.233 INFO:tasks.ceph:Scrubbing osd.4 2024-05-14T15:21:34.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:34.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.523+0000 7fa7b9c00640 1 Processor -- start 2024-05-14T15:21:34.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.523+0000 7fa7b9c00640 1 -- start start 2024-05-14T15:21:34.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.525+0000 7fa7b9c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 0x7fa7b415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.525+0000 7fa7b9c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b4160e20 con 0x7fa7b406de10 2024-05-14T15:21:34.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.525+0000 7fa7b9c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b409f8f0 con 0x7fa7b4070f10 2024-05-14T15:21:34.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.525+0000 7fa7b9c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b4161940 con 0x7fa7b4160a10 2024-05-14T15:21:34.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.526+0000 7fa7b2000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa7b406de10 0x7fa7b406f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34656/0 (socket says 172.21.15.2:34656) 2024-05-14T15:21:34.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.526+0000 7fa7b2000640 1 -- 172.21.15.2:0/3271859455 learned_addr learned my addr 172.21.15.2:0/3271859455 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.526+0000 7fa7b3400640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 0x7fa7b415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.526+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206253611 0 0) 0x7fa7a4001490 con 0x7fa7b406de10 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.526+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa798005730 con 0x7fa7b406de10 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3598836584 0 0) 0x7fa798005730 con 0x7fa7b406de10 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 msgr2=0x7fa7b415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 0x7fa7b415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 >> v1:172.21.15.156:6789/0 conn(0x7fa7b4070f10 legacy=0x7fa7b406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b41610a0 con 0x7fa7b406de10 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fa7a4001c40 con 0x7fa7b406de10 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 >> v1:172.21.15.2:6789/0 conn(0x7fa7b406de10 legacy=0x7fa7b406f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa798006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 0x7fa798006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798006fa0 0x7fa798007470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b4161940 con 0x7fa798005c90 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa79800dea0 con 0x7fa798006fa0 2024-05-14T15:21:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa79800e0a0 con 0x7fa7b4160a10 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.527+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa798006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b2000640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 0x7fa798006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b3400640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798006fa0 0x7fa798007470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 msgr2=0x7fa798006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4160a10 0x7fa798006a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798006fa0 msgr2=0x7fa798007470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798006fa0 0x7fa798007470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.528+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3271859455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798005730 con 0x7fa798005c90 2024-05-14T15:21:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.529+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa798006120 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40b1420 tx=0x7fa798007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ca258bfba8dceb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.529+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0013b0 con 0x7fa798005c90 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.529+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0052d0 con 0x7fa798005c90 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.529+0000 7fa7b1600640 1 -- 172.21.15.2:0/3271859455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c02aa70 con 0x7fa798005c90 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3271859455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 msgr2=0x7fa798006120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b9c00640 1 --2- 172.21.15.2:0/3271859455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa798006120 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40b1420 tx=0x7fa798007a40 comp rx=0 tx=0).stop 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b3400640 1 -- 172.21.15.2:0/3271859455 reap_dead start 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3271859455 shutdown_connections 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3271859455 >> 172.21.15.2:0/3271859455 conn(0x7fa7b40734e0 msgr2=0x7fa7b40738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3271859455 shutdown_connections 2024-05-14T15:21:34.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.530+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3271859455 wait complete. 2024-05-14T15:21:34.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.533+0000 7fa7b9c00640 1 Processor -- start 2024-05-14T15:21:34.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.533+0000 7fa7b9c00640 1 -- start start 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.534+0000 7fa7b9c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa7b414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.534+0000 7fa7b9c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4153d60 0x7fa7b415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.534+0000 7fa7b9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7b4154170 0x7fa7b415af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b9c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b4161660 con 0x7fa798005c90 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b9c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b406f420 con 0x7fa7b4154170 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b9c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b415cee0 con 0x7fa7b4153d60 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa7b414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa7b414ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45168/0 (socket says 172.21.15.2:45168) 2024-05-14T15:21:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3017912154 learned_addr learned my addr 172.21.15.2:0/3017912154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b2000640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4153d60 0x7fa7b415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.535+0000 7fa7b3400640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7b4154170 0x7fa7b415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4153d60 msgr2=0x7fa7b415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7b4153d60 0x7fa7b415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7b4154170 msgr2=0x7fa7b415af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7b4154170 0x7fa7b415af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b2a00640 1 -- 172.21.15.2:0/3017912154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b4158dd0 con 0x7fa798005c90 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b2a00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa7b414ff30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa79c02a520 tx=0x7fa79c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c037040 con 0x7fa798005c90 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c040070 con 0x7fa798005c90 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c006e00 con 0x7fa798005c90 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.536+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b41590b0 con 0x7fa798005c90 2024-05-14T15:21:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.537+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b4159670 con 0x7fa798005c90 2024-05-14T15:21:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.538+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7b4050870 con 0x7fa798005c90 2024-05-14T15:21:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.539+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa79c0052d0 con 0x7fa798005c90 2024-05-14T15:21:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.540+0000 7fa7aaa00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa790076350 0x7fa790078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.540+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fa79c0b6fe0 con 0x7fa798005c90 2024-05-14T15:21:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.540+0000 7fa7aaa00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7fa79007c840 0x7fa79007ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.540+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 --> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa79007f3a0 con 0x7fa79007c840 2024-05-14T15:21:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.540+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fa79c0be050 con 0x7fa798005c90 2024-05-14T15:21:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.541+0000 7fa7b2000640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa790076350 0x7fa790078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.541+0000 7fa7b3400640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7fa79007c840 0x7fa79007ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.542+0000 7fa7b2000640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa790076350 0x7fa790078860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4001790 tx=0x7fa7a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.542+0000 7fa7b3400640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7fa79007c840 0x7fa79007ecd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.545+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== osd.4 v2:172.21.15.156:6824/1273361273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa79007f3a0 con 0x7fa79007c840 2024-05-14T15:21:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.560+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 --> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa7b40b3070 con 0x7fa79007c840 2024-05-14T15:21:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7aaa00640 1 -- 172.21.15.2:0/3017912154 <== osd.4 v2:172.21.15.156:6824/1273361273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa7b40b3070 con 0x7fa79007c840 2024-05-14T15:21:34.561 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:34.561 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:34.561 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7fa79007c840 msgr2=0x7fa79007ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b9c00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6824/1273361273,v1:172.21.15.156:6825/1273361273] conn(0x7fa79007c840 0x7fa79007ecd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa790076350 msgr2=0x7fa790078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b9c00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fa790076350 0x7fa790078860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4001790 tx=0x7fa7a4009040 comp rx=0 tx=0).stop 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 msgr2=0x7fa7b414ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b9c00640 1 --2- 172.21.15.2:0/3017912154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa798005c90 0x7fa7b414ff30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa79c02a520 tx=0x7fa79c001120 comp rx=0 tx=0).stop 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.561+0000 7fa7b3400640 1 -- 172.21.15.2:0/3017912154 reap_dead start 2024-05-14T15:21:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.562+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 shutdown_connections 2024-05-14T15:21:34.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.562+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 >> 172.21.15.2:0/3017912154 conn(0x7fa7b40734e0 msgr2=0x7fa7b40d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:34.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.562+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 shutdown_connections 2024-05-14T15:21:34.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.562+0000 7fa7b9c00640 1 -- 172.21.15.2:0/3017912154 wait complete. 2024-05-14T15:21:34.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-14T15:21:34.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.873+0000 7fc19ea00640 1 Processor -- start 2024-05-14T15:21:34.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.873+0000 7fc19ea00640 1 -- start start 2024-05-14T15:21:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.875+0000 7fc19ea00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc1980b4ef0 0x7fc1981625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.875+0000 7fc19ea00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19815e7f0 con 0x7fc19806c6f0 2024-05-14T15:21:34.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.875+0000 7fc19ea00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19815ead0 con 0x7fc1980d0ff0 2024-05-14T15:21:34.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.875+0000 7fc19ea00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fc19815f5b0 con 0x7fc1980b4ef0 2024-05-14T15:21:34.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.876+0000 7fc19ca00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc19806c6f0 0x7fc19806cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34666/0 (socket says 172.21.15.2:34666) 2024-05-14T15:21:34.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.876+0000 7fc19ca00640 1 -- 172.21.15.2:0/1001513578 learned_addr learned my addr 172.21.15.2:0/1001513578 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.876+0000 7fc197400640 1 --2- 172.21.15.2:0/1001513578 >> v2:172.21.15.156:3300/0 conn(0x7fc1980b4ef0 0x7fc1981625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.876+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763748167 0 0) 0x7fc19815e7f0 con 0x7fc19806c6f0 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.876+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc17c003520 con 0x7fc19806c6f0 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2701496946 0 0) 0x7fc17c003520 con 0x7fc19806c6f0 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 >> v2:172.21.15.156:3300/0 conn(0x7fc1980b4ef0 msgr2=0x7fc1981625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 --2- 172.21.15.2:0/1001513578 >> v2:172.21.15.156:3300/0 conn(0x7fc1980b4ef0 0x7fc1981625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 >> v1:172.21.15.156:6789/0 conn(0x7fc1980d0ff0 legacy=0x7fc1980b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19815edb0 con 0x7fc19806c6f0 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fc1900016f0 con 0x7fc19806c6f0 2024-05-14T15:21:34.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 >> v1:172.21.15.2:6789/0 conn(0x7fc19806c6f0 legacy=0x7fc19806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc17c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc17c004800 0x7fc17c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc17c0052a0 0x7fc17c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc19815f5b0 con 0x7fc17c003aa0 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c00c230 con 0x7fc17c004800 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c00c430 con 0x7fc17c0052a0 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.877+0000 7fc197e00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc17c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc19ca00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc17c0052a0 0x7fc17c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc197400640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc17c004800 0x7fc17c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc197e00640 1 -- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc17c0052a0 msgr2=0x7fc17c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc197e00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc17c0052a0 0x7fc17c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc197e00640 1 -- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc17c004800 msgr2=0x7fc17c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc197e00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc17c004800 0x7fc17c004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc197e00640 1 -- 172.21.15.2:0/1001513578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c003520 con 0x7fc17c003aa0 2024-05-14T15:21:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.878+0000 7fc19ca00640 1 -- 172.21.15.2:0/1001513578 reap_dead start 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.879+0000 7fc197e00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc17c003f10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc188001e60 tx=0x7fc17c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25788c4404a00164 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.879+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188001ab0 con 0x7fc17c003aa0 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.879+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18802ae40 con 0x7fc17c003aa0 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.879+0000 7fc196a00640 1 -- 172.21.15.2:0/1001513578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188003b70 con 0x7fc17c003aa0 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.880+0000 7fc19ea00640 1 -- 172.21.15.2:0/1001513578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 msgr2=0x7fc17c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.880+0000 7fc19ea00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc17c003f10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc188001e60 tx=0x7fc17c005830 comp rx=0 tx=0).stop 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.880+0000 7fc19ea00640 1 -- 172.21.15.2:0/1001513578 shutdown_connections 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.880+0000 7fc19ea00640 1 --2- 172.21.15.2:0/1001513578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc17c003f10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.880+0000 7fc19ea00640 1 -- 172.21.15.2:0/1001513578 >> 172.21.15.2:0/1001513578 conn(0x7fc1980ce230 msgr2=0x7fc1980ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.881+0000 7fc19ea00640 1 -- 172.21.15.2:0/1001513578 shutdown_connections 2024-05-14T15:21:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.881+0000 7fc19ea00640 1 -- 172.21.15.2:0/1001513578 wait complete. 2024-05-14T15:21:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.883+0000 7fc19ea00640 1 Processor -- start 2024-05-14T15:21:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.883+0000 7fc19ea00640 1 -- start start 2024-05-14T15:21:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc19ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc19814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc19ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc19809bde0 0x7fc19815f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc19ea00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc19809c1f0 0x7fc19815fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc19ea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc19815be80 con 0x7fc17c003aa0 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc19ea00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc198071640 con 0x7fc19809bde0 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc19ea00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc19815c000 con 0x7fc19809c1f0 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc19814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc19814cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45188/0 (socket says 172.21.15.2:45188) 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 -- 172.21.15.2:0/2397241546 learned_addr learned my addr 172.21.15.2:0/2397241546 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197400640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc19809bde0 0x7fc19815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 -- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc19809c1f0 msgr2=0x7fc19815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc19809c1f0 0x7fc19815fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 -- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc19809bde0 msgr2=0x7fc19815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc19809bde0 0x7fc19815f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.885+0000 7fc197e00640 1 -- 172.21.15.2:0/2397241546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19809e6c0 con 0x7fc17c003aa0 2024-05-14T15:21:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.886+0000 7fc197e00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc19814cad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc188001e60 tx=0x7fc1880014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.886+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18803f030 con 0x7fc17c003aa0 2024-05-14T15:21:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.886+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18802ac40 con 0x7fc17c003aa0 2024-05-14T15:21:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.886+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188007df0 con 0x7fc17c003aa0 2024-05-14T15:21:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.886+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19809e9a0 con 0x7fc17c003aa0 2024-05-14T15:21:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.886+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19809ef60 con 0x7fc17c003aa0 2024-05-14T15:21:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.887+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc198050870 con 0x7fc17c003aa0 2024-05-14T15:21:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.889+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc188042070 con 0x7fc17c003aa0 2024-05-14T15:21:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.890+0000 7fc18fe00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc1780762d0 0x7fc1780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.890+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fc1880b7c70 con 0x7fc17c003aa0 2024-05-14T15:21:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.891+0000 7fc197400640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc1780762d0 0x7fc1780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.892+0000 7fc197400640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc1780762d0 0x7fc1780787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc1840090e0 tx=0x7fc184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:34.894+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc188081690 con 0x7fc17c003aa0 2024-05-14T15:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.104+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc1980cf140 con 0x7fc1780762d0 2024-05-14T15:21:35.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.105+0000 7fc18fe00640 1 -- 172.21.15.2:0/2397241546 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc1980cf140 con 0x7fc1780762d0 2024-05-14T15:21:35.106 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2024-05-14T15:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc1780762d0 msgr2=0x7fc1780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc1780762d0 0x7fc1780787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc1840090e0 tx=0x7fc184008040 comp rx=0 tx=0).stop 2024-05-14T15:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 msgr2=0x7fc19814cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc19814cad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc188001e60 tx=0x7fc1880014a0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 shutdown_connections 2024-05-14T15:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fc1780762d0 0x7fc1780787e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc19809bde0 0x7fc19815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc19809c1f0 0x7fc19815fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 --2- 172.21.15.2:0/2397241546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c003aa0 0x7fc19814cad0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 >> 172.21.15.2:0/2397241546 conn(0x7fc1980ce230 msgr2=0x7fc1980b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 shutdown_connections 2024-05-14T15:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.109+0000 7fc19ea00640 1 -- 172.21.15.2:0/2397241546 wait complete. 2024-05-14T15:21:35.136 INFO:tasks.ceph:Scrubbing osd.5 2024-05-14T15:21:35.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.427+0000 7f7880600640 1 Processor -- start 2024-05-14T15:21:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.427+0000 7f7880600640 1 -- start start 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.430+0000 7f7880600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7878070f10 0x7f7878160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.430+0000 7f7880600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f787806de10 0x7f787806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.430+0000 7f7880600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787809f8f0 con 0x7f787815cee0 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.430+0000 7f7880600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7878161940 con 0x7f7878070f10 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.430+0000 7f7880600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f787806f420 con 0x7f787806de10 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7878070f10 0x7f7878160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7878070f10 0x7f7878160a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45190/0 (socket says 172.21.15.2:45190) 2024-05-14T15:21:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 -- 172.21.15.2:0/2738481880 learned_addr learned my addr 172.21.15.2:0/2738481880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787e600640 1 --2- 172.21.15.2:0/2738481880 >> v2:172.21.15.156:3300/0 conn(0x7f787806de10 0x7f787806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 -- 172.21.15.2:0/2738481880 >> v2:172.21.15.156:3300/0 conn(0x7f787806de10 msgr2=0x7f787806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 --2- 172.21.15.2:0/2738481880 >> v2:172.21.15.156:3300/0 conn(0x7f787806de10 0x7f787806f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 -- 172.21.15.2:0/2738481880 >> v1:172.21.15.156:6789/0 conn(0x7f787815cee0 legacy=0x7f787806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787dc00640 1 -- 172.21.15.2:0/2738481880 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787815d2f0 con 0x7f7878070f10 2024-05-14T15:21:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.431+0000 7f787e600640 1 --2- 172.21.15.2:0/2738481880 >> v2:172.21.15.156:3300/0 conn(0x7f787806de10 0x7f787806f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.432+0000 7f787dc00640 1 --2- 172.21.15.2:0/2738481880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7878070f10 0x7f7878160a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7878161ac0 tx=0x7f786c02c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dab463e3874a9a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.433+0000 7f7877e00640 1 -- 172.21.15.2:0/2738481880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c032700 con 0x7f7878070f10 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.433+0000 7f7877e00640 1 -- 172.21.15.2:0/2738481880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c0328a0 con 0x7f7878070f10 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.433+0000 7f7877e00640 1 -- 172.21.15.2:0/2738481880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c032c70 con 0x7f7878070f10 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.433+0000 7f7880600640 1 -- 172.21.15.2:0/2738481880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7878070f10 msgr2=0x7f7878160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.433+0000 7f7880600640 1 --2- 172.21.15.2:0/2738481880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7878070f10 0x7f7878160a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7878161ac0 tx=0x7f786c02c800 comp rx=0 tx=0).stop 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.434+0000 7f7880600640 1 -- 172.21.15.2:0/2738481880 shutdown_connections 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.434+0000 7f7880600640 1 --2- 172.21.15.2:0/2738481880 >> v2:172.21.15.156:3300/0 conn(0x7f787806de10 0x7f787806f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.434+0000 7f7880600640 1 --2- 172.21.15.2:0/2738481880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7878070f10 0x7f7878160a10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.434+0000 7f7880600640 1 -- 172.21.15.2:0/2738481880 >> 172.21.15.2:0/2738481880 conn(0x7f78780734e0 msgr2=0x7f78780738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.434+0000 7f7880600640 1 -- 172.21.15.2:0/2738481880 shutdown_connections 2024-05-14T15:21:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.434+0000 7f7880600640 1 -- 172.21.15.2:0/2738481880 wait complete. 2024-05-14T15:21:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.436+0000 7f7880600640 1 Processor -- start 2024-05-14T15:21:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.436+0000 7f7880600640 1 -- start start 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f7880600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7878070f10 0x7f7878141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f7880600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787815cee0 0x7f78781fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f7880600640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78781e94f0 0x7f78781ea200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f7880600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7878161660 con 0x7f787815cee0 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f7880600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7878161380 con 0x7f7878070f10 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f7880600640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f787806fdf0 con 0x7f78781e94f0 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f787d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787815cee0 0x7f78781fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f787d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787815cee0 0x7f78781fa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45198/0 (socket says 172.21.15.2:45198) 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.438+0000 7f787d200640 1 -- 172.21.15.2:0/4141595066 learned_addr learned my addr 172.21.15.2:0/4141595066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787dc00640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7878070f10 0x7f7878141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787e600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78781e94f0 0x7f78781ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787d200640 1 -- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78781e94f0 msgr2=0x7f78781ea200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787d200640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78781e94f0 0x7f78781ea200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787d200640 1 -- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7878070f10 msgr2=0x7f7878141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787d200640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7878070f10 0x7f7878141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787d200640 1 -- 172.21.15.2:0/4141595066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78781f6830 con 0x7f787815cee0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.439+0000 7f787d200640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787815cee0 0x7f78781fa8d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f786400b3e0 tx=0x7f786400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.440+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864015020 con 0x7f787815cee0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.440+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7864011850 con 0x7f787815cee0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.440+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864011c40 con 0x7f787815cee0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.440+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7878141f50 con 0x7f787815cee0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.440+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7878142510 con 0x7f787815cee0 2024-05-14T15:21:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.441+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f787806e050 con 0x7f787815cee0 2024-05-14T15:21:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.442+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7864018020 con 0x7f787815cee0 2024-05-14T15:21:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.444+0000 7f7875600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78580762d0 0x7f78580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.444+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f7864097440 con 0x7f787815cee0 2024-05-14T15:21:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.444+0000 7f7875600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7f785807c7c0 0x7f785807ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.444+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 --> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f786400de50 con 0x7f785807c7c0 2024-05-14T15:21:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.444+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f786409e050 con 0x7f787815cee0 2024-05-14T15:21:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.444+0000 7f787dc00640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78580762d0 0x7f78580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.445+0000 7f787e600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7f785807c7c0 0x7f785807ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.446+0000 7f787e600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7f785807c7c0 0x7f785807ec50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.446+0000 7f787dc00640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78580762d0 0x7f78580787e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f786c037000 tx=0x7f786c032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.448+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== osd.5 v2:172.21.15.156:6816/1465481188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f786400de50 con 0x7f785807c7c0 2024-05-14T15:21:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.465+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 --> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7878141ce0 con 0x7f785807c7c0 2024-05-14T15:21:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.466+0000 7f7875600640 1 -- 172.21.15.2:0/4141595066 <== osd.5 v2:172.21.15.156:6816/1465481188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7878141ce0 con 0x7f785807c7c0 2024-05-14T15:21:35.466 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:35.466 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:35.466 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.466+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7f785807c7c0 msgr2=0x7f785807ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.466+0000 7f7880600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6816/1465481188,v1:172.21.15.156:6817/1465481188] conn(0x7f785807c7c0 0x7f785807ec50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78580762d0 msgr2=0x7f78580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f78580762d0 0x7f78580787e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f786c037000 tx=0x7f786c032000 comp rx=0 tx=0).stop 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787815cee0 msgr2=0x7f78781fa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 --2- 172.21.15.2:0/4141595066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f787815cee0 0x7f78781fa8d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f786400b3e0 tx=0x7f786400b8a0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f787e600640 1 -- 172.21.15.2:0/4141595066 reap_dead start 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 shutdown_connections 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 >> 172.21.15.2:0/4141595066 conn(0x7f78780734e0 msgr2=0x7f787806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 shutdown_connections 2024-05-14T15:21:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.467+0000 7f7880600640 1 -- 172.21.15.2:0/4141595066 wait complete. 2024-05-14T15:21:35.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-14T15:21:35.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.773+0000 7fba6ec00640 1 Processor -- start 2024-05-14T15:21:35.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.774+0000 7fba6ec00640 1 -- start start 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.775+0000 7fba6ec00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fba680b6a90 0x7fba680d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.775+0000 7fba6ec00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba680b9120 con 0x7fba680b6ea0 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.776+0000 7fba6ec00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba68162360 con 0x7fba680b8d10 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.776+0000 7fba6ec00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7fba680d2500 con 0x7fba680b6a90 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.776+0000 7fba6e200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fba680b6ea0 0x7fba680d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34672/0 (socket says 172.21.15.2:34672) 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.776+0000 7fba6e200640 1 -- 172.21.15.2:0/2124947338 learned_addr learned my addr 172.21.15.2:0/2124947338 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.776+0000 7fba6ce00640 1 --2- 172.21.15.2:0/2124947338 >> v2:172.21.15.156:3300/0 conn(0x7fba680b6a90 0x7fba680d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.776+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454110164 0 0) 0x7fba680b9120 con 0x7fba680b6ea0 2024-05-14T15:21:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba50003520 con 0x7fba680b6ea0 2024-05-14T15:21:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360788152 0 0) 0x7fba50003520 con 0x7fba680b6ea0 2024-05-14T15:21:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 >> v2:172.21.15.156:3300/0 conn(0x7fba680b6a90 msgr2=0x7fba680d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 --2- 172.21.15.2:0/2124947338 >> v2:172.21.15.156:3300/0 conn(0x7fba680b6a90 0x7fba680d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 >> v1:172.21.15.156:6789/0 conn(0x7fba680b8d10 legacy=0x7fba681619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba68162640 con 0x7fba680b6ea0 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fba60001a70 con 0x7fba680b6ea0 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 >> v1:172.21.15.2:6789/0 conn(0x7fba680b6ea0 legacy=0x7fba680d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba50003a50 0x7fba50003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba50005350 0x7fba5000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba680d2500 con 0x7fba50004800 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fba50010690 con 0x7fba50003a50 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fba50010890 con 0x7fba50005350 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.777+0000 7fba6ce00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6d800640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba50003a50 0x7fba50003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6ce00640 1 -- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba50005350 msgr2=0x7fba5000fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6e200640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba50005350 0x7fba5000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6ce00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba50005350 0x7fba5000fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6ce00640 1 -- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba50003a50 msgr2=0x7fba50003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6ce00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba50003a50 0x7fba50003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6ce00640 1 -- 172.21.15.2:0/2124947338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba50003520 con 0x7fba50004800 2024-05-14T15:21:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.778+0000 7fba6e200640 1 -- 172.21.15.2:0/2124947338 reap_dead start 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.779+0000 7fba6ce00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba50004c10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fba54009ac0 tx=0x7fba50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d46ad3b014d464 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54036070 con 0x7fba50004800 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba54031400 con 0x7fba50004800 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba67e00640 1 -- 172.21.15.2:0/2124947338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54009690 con 0x7fba50004800 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba6ec00640 1 -- 172.21.15.2:0/2124947338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 msgr2=0x7fba50004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba6ec00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba50004c10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fba54009ac0 tx=0x7fba50005830 comp rx=0 tx=0).stop 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba6ec00640 1 -- 172.21.15.2:0/2124947338 shutdown_connections 2024-05-14T15:21:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba6ec00640 1 --2- 172.21.15.2:0/2124947338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba50004c10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.780+0000 7fba6ec00640 1 -- 172.21.15.2:0/2124947338 >> 172.21.15.2:0/2124947338 conn(0x7fba680b52e0 msgr2=0x7fba680b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.781+0000 7fba6ec00640 1 -- 172.21.15.2:0/2124947338 shutdown_connections 2024-05-14T15:21:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.781+0000 7fba6ec00640 1 -- 172.21.15.2:0/2124947338 wait complete. 2024-05-14T15:21:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.783+0000 7fba6ec00640 1 Processor -- start 2024-05-14T15:21:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.783+0000 7fba6ec00640 1 -- start start 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6ec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba680c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6ec00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba680c9650 0x7fba6815fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6ec00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba68160350 0x7fba680cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6ec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba680ce310 con 0x7fba50004800 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6ec00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fba68162920 con 0x7fba680c9650 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6ec00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fba680ce490 con 0x7fba68160350 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba680c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba680c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45208/0 (socket says 172.21.15.2:45208) 2024-05-14T15:21:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.785+0000 7fba6d800640 1 -- 172.21.15.2:0/112020024 learned_addr learned my addr 172.21.15.2:0/112020024 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6d800640 1 -- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba68160350 msgr2=0x7fba680cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6d800640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba68160350 0x7fba680cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6d800640 1 -- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba680c9650 msgr2=0x7fba6815fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6ce00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba680c9650 0x7fba6815fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6d800640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba680c9650 0x7fba6815fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6d800640 1 -- 172.21.15.2:0/112020024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba68160760 con 0x7fba50004800 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6d800640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba680c9110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00e4b0 tx=0x7fba5c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c005320 con 0x7fba50004800 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c0067d0 con 0x7fba50004800 2024-05-14T15:21:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba680c9e90 con 0x7fba50004800 2024-05-14T15:21:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.786+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c006bc0 con 0x7fba50004800 2024-05-14T15:21:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.787+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6806e4a0 con 0x7fba50004800 2024-05-14T15:21:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.788+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba68050870 con 0x7fba50004800 2024-05-14T15:21:35.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.789+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba5c007030 con 0x7fba50004800 2024-05-14T15:21:35.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.790+0000 7fba65600640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fba48076300 0x7fba48078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:35.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.790+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fba5c096c00 con 0x7fba50004800 2024-05-14T15:21:35.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.791+0000 7fba6ce00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fba48076300 0x7fba48078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.792+0000 7fba6ce00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fba48076300 0x7fba48078810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba54033000 tx=0x7fba54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:35.795+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fba68160760 con 0x7fba50004800 2024-05-14T15:21:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.006+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fba680ca170 con 0x7fba48076300 2024-05-14T15:21:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.007+0000 7fba65600640 1 -- 172.21.15.2:0/112020024 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fba680ca170 con 0x7fba48076300 2024-05-14T15:21:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2024-05-14T15:21:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fba48076300 msgr2=0x7fba48078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fba48076300 0x7fba48078810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba54033000 tx=0x7fba54008030 comp rx=0 tx=0).stop 2024-05-14T15:21:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 msgr2=0x7fba680c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba680c9110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00e4b0 tx=0x7fba5c00e970 comp rx=0 tx=0).stop 2024-05-14T15:21:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 shutdown_connections 2024-05-14T15:21:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fba48076300 0x7fba48078810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba680c9650 0x7fba6815fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba68160350 0x7fba680cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 --2- 172.21.15.2:0/112020024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba50004800 0x7fba680c9110 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 >> 172.21.15.2:0/112020024 conn(0x7fba680b52e0 msgr2=0x7fba680b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 shutdown_connections 2024-05-14T15:21:36.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.010+0000 7fba6ec00640 1 -- 172.21.15.2:0/112020024 wait complete. 2024-05-14T15:21:36.036 INFO:tasks.ceph:Scrubbing osd.6 2024-05-14T15:21:36.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:36.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.334+0000 7f50c7e00640 1 Processor -- start 2024-05-14T15:21:36.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.334+0000 7f50c7e00640 1 -- start start 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.336+0000 7f50c7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50c8160160 0x7f50c80d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.336+0000 7f50c7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50c80d0e50 0x7f50c806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c7e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c80b96a0 con 0x7f50c80cc5e0 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c7e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f50c8160570 con 0x7f50c8160160 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c7e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f50c80d1260 con 0x7f50c80d0e50 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c6000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50c8160160 0x7f50c80d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c6a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f50c80cc5e0 0x7f50c80b8f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34688/0 (socket says 172.21.15.2:34688) 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c6a00640 1 -- 172.21.15.2:0/3661002018 learned_addr learned my addr 172.21.15.2:0/3661002018 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:36.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c6000640 1 --2- 172.21.15.2:0/3661002018 >> v2:172.21.15.2:3300/0 conn(0x7f50c8160160 0x7f50c80d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45220/0 (socket says 172.21.15.2:45220) 2024-05-14T15:21:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c6000640 1 -- 172.21.15.2:0/3661002018 >> v2:172.21.15.156:3300/0 conn(0x7f50c80d0e50 msgr2=0x7f50c806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:36.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c7400640 1 --2- 172.21.15.2:0/3661002018 >> v2:172.21.15.156:3300/0 conn(0x7f50c80d0e50 0x7f50c806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.337+0000 7f50c5600640 1 -- 172.21.15.2:0/3661002018 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975318230 0 0) 0x7f50b8001490 con 0x7f50c80cc5e0 2024-05-14T15:21:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.338+0000 7f50c6000640 1 --2- 172.21.15.2:0/3661002018 >> v2:172.21.15.156:3300/0 conn(0x7f50c80d0e50 0x7f50c806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.338+0000 7f50c6000640 1 -- 172.21.15.2:0/3661002018 >> v1:172.21.15.2:6789/0 conn(0x7f50c80cc5e0 legacy=0x7f50c80b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.338+0000 7f50c6000640 1 -- 172.21.15.2:0/3661002018 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c80d4750 con 0x7f50c8160160 2024-05-14T15:21:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.338+0000 7f50c7400640 1 --2- 172.21.15.2:0/3661002018 >> v2:172.21.15.156:3300/0 conn(0x7f50c80d0e50 0x7f50c806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:36.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.339+0000 7f50c6000640 1 --2- 172.21.15.2:0/3661002018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8160160 0x7f50c80d0910 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f50c8164c90 tx=0x7f50b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0179a2fdabc983a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.339+0000 7f50c5600640 1 -- 172.21.15.2:0/3661002018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4037070 con 0x7f50c8160160 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.339+0000 7f50c5600640 1 -- 172.21.15.2:0/3661002018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b4032440 con 0x7f50c8160160 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.339+0000 7f50c5600640 1 -- 172.21.15.2:0/3661002018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b402ae60 con 0x7f50c8160160 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 -- 172.21.15.2:0/3661002018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8160160 msgr2=0x7f50c80d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 --2- 172.21.15.2:0/3661002018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8160160 0x7f50c80d0910 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f50c8164c90 tx=0x7f50b402a110 comp rx=0 tx=0).stop 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 -- 172.21.15.2:0/3661002018 shutdown_connections 2024-05-14T15:21:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 --2- 172.21.15.2:0/3661002018 >> v2:172.21.15.156:3300/0 conn(0x7f50c80d0e50 0x7f50c806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 --2- 172.21.15.2:0/3661002018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8160160 0x7f50c80d0910 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 -- 172.21.15.2:0/3661002018 >> 172.21.15.2:0/3661002018 conn(0x7f50c80d5ff0 msgr2=0x7f50c80d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 -- 172.21.15.2:0/3661002018 shutdown_connections 2024-05-14T15:21:36.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.340+0000 7f50c7e00640 1 -- 172.21.15.2:0/3661002018 wait complete. 2024-05-14T15:21:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.342+0000 7f50c7e00640 1 Processor -- start 2024-05-14T15:21:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.343+0000 7f50c7e00640 1 -- start start 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c80cc5e0 0x7f50c80c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c80d0e50 0x7f50c81606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50c8160160 0x7f50c80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c7e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50c806ca70 con 0x7f50c80cc5e0 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c7e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f50c806c790 con 0x7f50c80d0e50 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c7e00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f50c806cd50 con 0x7f50c8160160 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.344+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c80cc5e0 0x7f50c80c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c80cc5e0 0x7f50c80c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45236/0 (socket says 172.21.15.2:45236) 2024-05-14T15:21:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 -- 172.21.15.2:0/120040678 learned_addr learned my addr 172.21.15.2:0/120040678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6000640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c80d0e50 0x7f50c81606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 -- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50c8160160 msgr2=0x7f50c80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50c8160160 0x7f50c80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 -- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c80d0e50 msgr2=0x7f50c81606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c80d0e50 0x7f50c81606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 -- 172.21.15.2:0/120040678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81f6600 con 0x7f50c80cc5e0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.345+0000 7f50c6a00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c80cc5e0 0x7f50c80c8450 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c730 tx=0x7f50b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.346+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8018070 con 0x7f50c80cc5e0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.346+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b800ce40 con 0x7f50c80cc5e0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.346+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b800a880 con 0x7f50c80cc5e0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.346+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c81f68e0 con 0x7f50c80cc5e0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.346+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81f6ea0 con 0x7f50c80cc5e0 2024-05-14T15:21:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.347+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50c8163680 con 0x7f50c80cc5e0 2024-05-14T15:21:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.349+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50b800aa20 con 0x7f50c80cc5e0 2024-05-14T15:21:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.349+0000 7f50bea00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50a8076300 0x7f50a8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.350+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f50b8096f20 con 0x7f50c80cc5e0 2024-05-14T15:21:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.350+0000 7f50bea00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f50a807c7f0 0x7f50a807ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.350+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 --> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50b8017ec0 con 0x7f50a807c7f0 2024-05-14T15:21:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.350+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f50b80972d0 con 0x7f50c80cc5e0 2024-05-14T15:21:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.350+0000 7f50c6000640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50a8076300 0x7f50a8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.351+0000 7f50c7400640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f50a807c7f0 0x7f50a807ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.352+0000 7f50c6000640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50a8076300 0x7f50a8078810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f50b4034000 tx=0x7f50b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.352+0000 7f50c7400640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f50a807c7f0 0x7f50a807ec80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.354+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== osd.6 v2:172.21.15.156:6800/1299720883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50b8017ec0 con 0x7f50a807c7f0 2024-05-14T15:21:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.369+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 --> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50c8050870 con 0x7f50a807c7f0 2024-05-14T15:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.370+0000 7f50bea00640 1 -- 172.21.15.2:0/120040678 <== osd.6 v2:172.21.15.156:6800/1299720883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f50c8050870 con 0x7f50a807c7f0 2024-05-14T15:21:36.370 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:36.370 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:36.370 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.370+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f50a807c7f0 msgr2=0x7f50a807ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.370+0000 7f50c7e00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6800/1299720883,v1:172.21.15.156:6801/1299720883] conn(0x7f50a807c7f0 0x7f50a807ec80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50a8076300 msgr2=0x7f50a8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50a8076300 0x7f50a8078810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f50b4034000 tx=0x7f50b402e000 comp rx=0 tx=0).stop 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c80cc5e0 msgr2=0x7f50c80c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 --2- 172.21.15.2:0/120040678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c80cc5e0 0x7f50c80c8450 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c730 tx=0x7f50b800cbf0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7400640 1 -- 172.21.15.2:0/120040678 reap_dead start 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 shutdown_connections 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 >> 172.21.15.2:0/120040678 conn(0x7f50c80d5ff0 msgr2=0x7f50c81599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 shutdown_connections 2024-05-14T15:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.371+0000 7f50c7e00640 1 -- 172.21.15.2:0/120040678 wait complete. 2024-05-14T15:21:36.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-14T15:21:36.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.676+0000 7f8a08c00640 1 Processor -- start 2024-05-14T15:21:36.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.676+0000 7f8a08c00640 1 -- start start 2024-05-14T15:21:36.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.678+0000 7f8a08c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 0x7f8a040cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.678+0000 7f8a08c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a040d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.678+0000 7f8a08c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a040b0360 con 0x7f8a040af630 2024-05-14T15:21:36.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.678+0000 7f8a08c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f8a040b0f70 con 0x7f8a04161f10 2024-05-14T15:21:36.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.678+0000 7f8a08c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f8a040b0640 con 0x7f8a040cfc70 2024-05-14T15:21:36.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.679+0000 7f89faa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 0x7f8a040cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.679+0000 7f89faa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 0x7f8a040cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:50008/0 (socket says 172.21.15.2:50008) 2024-05-14T15:21:36.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.679+0000 7f89faa00640 1 -- 172.21.15.2:0/1339904774 learned_addr learned my addr 172.21.15.2:0/1339904774 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:36.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.679+0000 7f8a03e00640 1 --2- 172.21.15.2:0/1339904774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a040d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.680+0000 7f8a03e00640 1 -- 172.21.15.2:0/1339904774 >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 msgr2=0x7f8a040cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:36.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.680+0000 7f8a03e00640 1 --2- 172.21.15.2:0/1339904774 >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 0x7f8a040cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.680+0000 7f8a03e00640 1 -- 172.21.15.2:0/1339904774 >> v1:172.21.15.156:6789/0 conn(0x7f8a040af630 legacy=0x7f8a04161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.680+0000 7f8a03e00640 1 -- 172.21.15.2:0/1339904774 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a040b0920 con 0x7f8a040cfc70 2024-05-14T15:21:36.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.680+0000 7f89faa00640 1 --2- 172.21.15.2:0/1339904774 >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 0x7f8a040cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:21:36.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.681+0000 7f8a03e00640 1 --2- 172.21.15.2:0/1339904774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a040d0080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009d90 tx=0x7f89fc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1be0598fde6bde server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.682+0000 7f8a02a00640 1 -- 172.21.15.2:0/1339904774 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc007740 con 0x7f8a040cfc70 2024-05-14T15:21:36.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.682+0000 7f8a02a00640 1 -- 172.21.15.2:0/1339904774 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc0078e0 con 0x7f8a040cfc70 2024-05-14T15:21:36.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.682+0000 7f8a02a00640 1 -- 172.21.15.2:0/1339904774 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc007cb0 con 0x7f8a040cfc70 2024-05-14T15:21:36.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 -- 172.21.15.2:0/1339904774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 msgr2=0x7f8a040d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 --2- 172.21.15.2:0/1339904774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a040d0080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009d90 tx=0x7f89fc02a660 comp rx=0 tx=0).stop 2024-05-14T15:21:36.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 -- 172.21.15.2:0/1339904774 shutdown_connections 2024-05-14T15:21:36.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 --2- 172.21.15.2:0/1339904774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a040d0080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 --2- 172.21.15.2:0/1339904774 >> v2:172.21.15.156:3300/0 conn(0x7f8a04161f10 0x7f8a040cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 -- 172.21.15.2:0/1339904774 >> 172.21.15.2:0/1339904774 conn(0x7f8a040739a0 msgr2=0x7f8a04073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 -- 172.21.15.2:0/1339904774 shutdown_connections 2024-05-14T15:21:36.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.683+0000 7f8a08c00640 1 -- 172.21.15.2:0/1339904774 wait complete. 2024-05-14T15:21:36.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.686+0000 7f8a08c00640 1 Processor -- start 2024-05-14T15:21:36.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.686+0000 7f8a08c00640 1 -- start start 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.687+0000 7f8a08c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a040af630 0x7f8a04141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.687+0000 7f8a08c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a041409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.687+0000 7f8a08c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 0x7f8a040b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.687+0000 7f8a08c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040afa40 con 0x7f8a040b56a0 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.687+0000 7f8a08c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04162560 con 0x7f8a040af630 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.687+0000 7f8a08c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f8a040afbc0 con 0x7f8a040cfc70 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 0x7f8a040b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 0x7f8a040b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45252/0 (socket says 172.21.15.2:45252) 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 -- 172.21.15.2:0/4156027792 learned_addr learned my addr 172.21.15.2:0/4156027792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:36.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f89faa00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a041409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03400640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a040af630 0x7f8a04141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 -- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 msgr2=0x7f8a041409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a041409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 -- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a040af630 msgr2=0x7f8a04141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a040af630 0x7f8a04141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.688+0000 7f8a03e00640 1 -- 172.21.15.2:0/4156027792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a040b4ee0 con 0x7f8a040b56a0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.689+0000 7f8a03e00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 0x7f8a040b5ab0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009eb0 tx=0x7f89fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.689+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc03f070 con 0x7f8a040b56a0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.689+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc031bc0 con 0x7f8a040b56a0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.689+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a04157880 con 0x7f8a040b56a0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.689+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc009450 con 0x7f8a040b56a0 2024-05-14T15:21:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.689+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a040b5180 con 0x7f8a040b56a0 2024-05-14T15:21:36.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.690+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04155440 con 0x7f8a040b56a0 2024-05-14T15:21:36.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.692+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89fc044460 con 0x7f8a040b56a0 2024-05-14T15:21:36.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.693+0000 7f89fbe00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f89e00762d0 0x7f89e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.693+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f89fc0b8a60 con 0x7f8a040b56a0 2024-05-14T15:21:36.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.694+0000 7f8a03400640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f89e00762d0 0x7f89e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.695+0000 7f8a03400640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f89e00762d0 0x7f89e00787e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89f40015e0 tx=0x7f89f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.697+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f89fc04b030 con 0x7f8a040b56a0 2024-05-14T15:21:36.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.908+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f8a040cf130 con 0x7f89e00762d0 2024-05-14T15:21:36.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.909+0000 7f89fbe00640 1 -- 172.21.15.2:0/4156027792 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8a040cf130 con 0x7f89e00762d0 2024-05-14T15:21:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2024-05-14T15:21:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f89e00762d0 msgr2=0x7f89e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f89e00762d0 0x7f89e00787e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89f40015e0 tx=0x7f89f4009040 comp rx=0 tx=0).stop 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 msgr2=0x7f8a040b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 0x7f8a040b5ab0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009eb0 tx=0x7f89fc004a40 comp rx=0 tx=0).stop 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 shutdown_connections 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f89e00762d0 0x7f89e00787e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a040b56a0 0x7f8a040b5ab0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a040cfc70 0x7f8a041409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 --2- 172.21.15.2:0/4156027792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a040af630 0x7f8a04141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.912+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 >> 172.21.15.2:0/4156027792 conn(0x7f8a040739a0 msgr2=0x7f8a04161790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.913+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 shutdown_connections 2024-05-14T15:21:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:36.913+0000 7f8a08c00640 1 -- 172.21.15.2:0/4156027792 wait complete. 2024-05-14T15:21:36.939 INFO:tasks.ceph:Scrubbing osd.7 2024-05-14T15:21:36.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-14T15:21:37.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.219+0000 7fc009000640 1 Processor -- start 2024-05-14T15:21:37.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.219+0000 7fc009000640 1 -- start start 2024-05-14T15:21:37.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.221+0000 7fc009000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00406de10 0x7fc0040af620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.221+0000 7fc009000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0040d0e80 con 0x7fc0040d0a70 2024-05-14T15:21:37.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.221+0000 7fc009000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc004161db0 con 0x7fc00409f570 2024-05-14T15:21:37.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.221+0000 7fc009000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc004161b60 con 0x7fc00406de10 2024-05-14T15:21:37.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.221+0000 7fc002800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc0040d0a70 0x7fc0040cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34694/0 (socket says 172.21.15.2:34694) 2024-05-14T15:21:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.221+0000 7fc002800640 1 -- 172.21.15.2:0/969913358 learned_addr learned my addr 172.21.15.2:0/969913358 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc001400640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00406de10 0x7fc0040af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018501040 0 0) 0x7fc0040d0e80 con 0x7fc0040d0a70 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe8003520 con 0x7fc0040d0a70 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1730732042 0 0) 0x7fbfe8003520 con 0x7fc0040d0a70 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00406de10 msgr2=0x7fc0040af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00406de10 0x7fc0040af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 >> v1:172.21.15.156:6789/0 conn(0x7fc00409f570 legacy=0x7fc00406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc004162090 con 0x7fc0040d0a70 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.222+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7fbffc001a70 con 0x7fc0040d0a70 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 >> v1:172.21.15.2:6789/0 conn(0x7fc0040d0a70 legacy=0x7fc0040cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe8003a80 0x7fbfe8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfe8004800 0x7fbfe8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe80051a0 0x7fbfe800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc004161b60 con 0x7fbfe80051a0 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe800bfe0 con 0x7fbfe8003a80 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe800c1e0 con 0x7fbfe8004800 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc002800640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe80051a0 0x7fbfe800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc001e00640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe8003a80 0x7fbfe8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc001400640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfe8004800 0x7fbfe8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc002800640 1 -- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfe8004800 msgr2=0x7fbfe8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.223+0000 7fc002800640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfe8004800 0x7fbfe8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.224+0000 7fc002800640 1 -- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe8003a80 msgr2=0x7fbfe8003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.224+0000 7fc002800640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe8003a80 0x7fbfe8003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.224+0000 7fc002800640 1 -- 172.21.15.2:0/969913358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe8003520 con 0x7fbfe80051a0 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.224+0000 7fc001e00640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe8003a80 0x7fbfe8003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.224+0000 7fc001400640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfe8004800 0x7fbfe8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:37.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.225+0000 7fc002800640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe80051a0 0x7fbfe800b9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc0040af0b0 tx=0x7fbfe8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cc8b31ce833c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.225+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00a3f0 con 0x7fbfe80051a0 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.225+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc02f070 con 0x7fbfe80051a0 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.225+0000 7fc000a00640 1 -- 172.21.15.2:0/969913358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc02bb10 con 0x7fbfe80051a0 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc009000640 1 -- 172.21.15.2:0/969913358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe80051a0 msgr2=0x7fbfe800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc009000640 1 --2- 172.21.15.2:0/969913358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe80051a0 0x7fbfe800b9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc0040af0b0 tx=0x7fbfe8005830 comp rx=0 tx=0).stop 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc002800640 1 -- 172.21.15.2:0/969913358 reap_dead start 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc009000640 1 -- 172.21.15.2:0/969913358 shutdown_connections 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc009000640 1 -- 172.21.15.2:0/969913358 >> 172.21.15.2:0/969913358 conn(0x7fc0040734e0 msgr2=0x7fc0040738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc009000640 1 -- 172.21.15.2:0/969913358 shutdown_connections 2024-05-14T15:21:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.226+0000 7fc009000640 1 -- 172.21.15.2:0/969913358 wait complete. 2024-05-14T15:21:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.228+0000 7fc009000640 1 Processor -- start 2024-05-14T15:21:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.229+0000 7fc009000640 1 -- start start 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.230+0000 7fc009000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe80051a0 0x7fc00414c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.230+0000 7fc009000640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00415f0b0 0x7fc00415f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.230+0000 7fc009000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00415feb0 0x7fc0040cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.230+0000 7fc009000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc00406de10 con 0x7fc00415feb0 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.230+0000 7fc009000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc004162650 con 0x7fbfe80051a0 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.230+0000 7fc009000640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7fc00406df90 con 0x7fc00415f0b0 2024-05-14T15:21:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00415feb0 0x7fc0040cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00415feb0 0x7fc0040cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45268/0 (socket says 172.21.15.2:45268) 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 -- 172.21.15.2:0/1802221276 learned_addr learned my addr 172.21.15.2:0/1802221276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc001400640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00415f0b0 0x7fc00415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc001e00640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe80051a0 0x7fc00414c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 -- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00415f0b0 msgr2=0x7fc00415f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc00415f0b0 0x7fc00415f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 -- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe80051a0 msgr2=0x7fc00414c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe80051a0 0x7fc00414c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.231+0000 7fc002800640 1 -- 172.21.15.2:0/1802221276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041606b0 con 0x7fc00415feb0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.232+0000 7fc002800640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00415feb0 0x7fc0040cb760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbffc02b380 tx=0x7fc004162260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.232+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc001f30 con 0x7fc00415feb0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.232+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc00a3d0 con 0x7fc00415feb0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.232+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc02cc50 con 0x7fc00415feb0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.232+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc004160990 con 0x7fc00415feb0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.232+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00414c550 con 0x7fc00415feb0 2024-05-14T15:21:37.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.233+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0041613c0 con 0x7fc00415feb0 2024-05-14T15:21:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.235+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbffc03e070 con 0x7fc00415feb0 2024-05-14T15:21:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.236+0000 7fbffa000640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbfe00762d0 0x7fbfe00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.236+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fbffc0b7660 con 0x7fc00415feb0 2024-05-14T15:21:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.236+0000 7fbffa000640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7fbfe007c7c0 0x7fbfe007ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.236+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 --> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbffc04eea0 con 0x7fbfe007c7c0 2024-05-14T15:21:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.236+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fbffc0b7a10 con 0x7fc00415feb0 2024-05-14T15:21:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.237+0000 7fc001e00640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbfe00762d0 0x7fbfe00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.237+0000 7fc001400640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7fbfe007c7c0 0x7fbfe007ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.238+0000 7fc001400640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7fbfe007c7c0 0x7fbfe007ec50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.238+0000 7fc001e00640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbfe00762d0 0x7fbfe00787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbff4001790 tx=0x7fbff4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.240+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== osd.7 v2:172.21.15.156:6808/784939538 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbffc04eea0 con 0x7fbfe007c7c0 2024-05-14T15:21:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.256+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 --> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc00409f230 con 0x7fbfe007c7c0 2024-05-14T15:21:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.257+0000 7fbffa000640 1 -- 172.21.15.2:0/1802221276 <== osd.7 v2:172.21.15.156:6808/784939538 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc00409f230 con 0x7fbfe007c7c0 2024-05-14T15:21:37.257 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-05-14T15:21:37.257 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T15:21:37.257 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-05-14T15:21:37.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.257+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7fbfe007c7c0 msgr2=0x7fbfe007ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.257+0000 7fc009000640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6808/784939538,v1:172.21.15.156:6809/784939538] conn(0x7fbfe007c7c0 0x7fbfe007ec50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbfe00762d0 msgr2=0x7fbfe00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7fbfe00762d0 0x7fbfe00787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbff4001790 tx=0x7fbff4009040 comp rx=0 tx=0).stop 2024-05-14T15:21:37.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00415feb0 msgr2=0x7fc0040cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 --2- 172.21.15.2:0/1802221276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00415feb0 0x7fc0040cb760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbffc02b380 tx=0x7fc004162260 comp rx=0 tx=0).stop 2024-05-14T15:21:37.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc002800640 1 -- 172.21.15.2:0/1802221276 reap_dead start 2024-05-14T15:21:37.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 shutdown_connections 2024-05-14T15:21:37.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 >> 172.21.15.2:0/1802221276 conn(0x7fc0040734e0 msgr2=0x7fc0040b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 shutdown_connections 2024-05-14T15:21:37.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.258+0000 7fc009000640 1 -- 172.21.15.2:0/1802221276 wait complete. 2024-05-14T15:21:37.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-14T15:21:37.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.568+0000 7f38d8a00640 1 Processor -- start 2024-05-14T15:21:37.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.568+0000 7f38d8a00640 1 -- start start 2024-05-14T15:21:37.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d8a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38d4163bc0 0x7f38d40b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d8a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38d40d13c0 0x7f38d40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d8a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d0d40 0x7f38d406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d8a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f38d40d1150 con 0x7f38d40d13c0 2024-05-14T15:21:37.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d8a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f38d40d48a0 con 0x7f38d4163bc0 2024-05-14T15:21:37.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d8a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f38d40d4b80 con 0x7f38d40d0d40 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d1400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38d40d13c0 0x7f38d40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d1400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38d40d13c0 0x7f38d40d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45282/0 (socket says 172.21.15.2:45282) 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.571+0000 7f38d1400640 1 -- 172.21.15.2:0/2795067297 learned_addr learned my addr 172.21.15.2:0/2795067297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.572+0000 7f38d1400640 1 -- 172.21.15.2:0/2795067297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d0d40 msgr2=0x7f38d406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.572+0000 7f38d1400640 1 --2- 172.21.15.2:0/2795067297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d0d40 0x7f38d406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.572+0000 7f38d1400640 1 -- 172.21.15.2:0/2795067297 >> v2:172.21.15.156:3300/0 conn(0x7f38d4163bc0 msgr2=0x7f38d40b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:37.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.572+0000 7f38d1400640 1 --2- 172.21.15.2:0/2795067297 >> v2:172.21.15.156:3300/0 conn(0x7f38d4163bc0 0x7f38d40b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.572+0000 7f38d1400640 1 -- 172.21.15.2:0/2795067297 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d40d4e60 con 0x7f38d40d13c0 2024-05-14T15:21:37.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.573+0000 7f38d1400640 1 --2- 172.21.15.2:0/2795067297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d13c0 0x7f38d40d0800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f38d40d6be0 tx=0x7f38c002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c0a5e9cc98c19b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.573+0000 7f38d0a00640 1 -- 172.21.15.2:0/2795067297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0037070 con 0x7f38d40d13c0 2024-05-14T15:21:37.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.573+0000 7f38d0a00640 1 -- 172.21.15.2:0/2795067297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c0032440 con 0x7f38d40d13c0 2024-05-14T15:21:37.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.573+0000 7f38d0a00640 1 -- 172.21.15.2:0/2795067297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0032810 con 0x7f38d40d13c0 2024-05-14T15:21:37.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 -- 172.21.15.2:0/2795067297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d13c0 msgr2=0x7f38d40d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 --2- 172.21.15.2:0/2795067297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d13c0 0x7f38d40d0800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f38d40d6be0 tx=0x7f38c002a200 comp rx=0 tx=0).stop 2024-05-14T15:21:37.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 -- 172.21.15.2:0/2795067297 shutdown_connections 2024-05-14T15:21:37.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 --2- 172.21.15.2:0/2795067297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d0d40 0x7f38d406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 --2- 172.21.15.2:0/2795067297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d13c0 0x7f38d40d0800 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 --2- 172.21.15.2:0/2795067297 >> v2:172.21.15.156:3300/0 conn(0x7f38d4163bc0 0x7f38d40b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 -- 172.21.15.2:0/2795067297 >> 172.21.15.2:0/2795067297 conn(0x7f38d40d2bc0 msgr2=0x7f38d40d5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 -- 172.21.15.2:0/2795067297 shutdown_connections 2024-05-14T15:21:37.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.574+0000 7f38d8a00640 1 -- 172.21.15.2:0/2795067297 wait complete. 2024-05-14T15:21:37.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.577+0000 7f38d8a00640 1 Processor -- start 2024-05-14T15:21:37.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.577+0000 7f38d8a00640 1 -- start start 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 0x7f38d40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d8a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d13c0 0x7f38d414de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d8a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38d4163bc0 0x7f38d406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d8a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38d40d4450 con 0x7f38d40d0d40 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d8a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f38d40d5420 con 0x7f38d4163bc0 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d8a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f38d40d45d0 con 0x7f38d40d13c0 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.578+0000 7f38d1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 0x7f38d40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 0x7f38d40ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45290/0 (socket says 172.21.15.2:45290) 2024-05-14T15:21:37.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 -- 172.21.15.2:0/3747461574 learned_addr learned my addr 172.21.15.2:0/3747461574 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d2800640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38d4163bc0 0x7f38d406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1400640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d13c0 0x7f38d414de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 -- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d13c0 msgr2=0x7f38d414de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d13c0 0x7f38d414de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 -- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38d4163bc0 msgr2=0x7f38d406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38d4163bc0 0x7f38d406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 -- 172.21.15.2:0/3747461574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d41e9ac0 con 0x7f38d40d0d40 2024-05-14T15:21:37.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d2800640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38d4163bc0 0x7f38d406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.579+0000 7f38d1e00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 0x7f38d40ca4d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f38c400b9f0 tx=0x7f38c400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.580+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4019070 con 0x7f38d40d0d40 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.580+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c400cbd0 con 0x7f38d40d0d40 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.580+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4014440 con 0x7f38d40d0d40 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.580+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d41e9da0 con 0x7f38d40d0d40 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.580+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d41ea360 con 0x7f38d40d0d40 2024-05-14T15:21:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.581+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d4050870 con 0x7f38d40d0d40 2024-05-14T15:21:37.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.582+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38c401c070 con 0x7f38d40d0d40 2024-05-14T15:21:37.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.584+0000 7f38ca000640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f38b40762d0 0x7f38b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.584+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f38c4097240 con 0x7f38d40d0d40 2024-05-14T15:21:37.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.584+0000 7f38d1400640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f38b40762d0 0x7f38b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.586+0000 7f38d1400640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f38b40762d0 0x7f38b40787e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f38c0034000 tx=0x7f38c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.588+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f38c4060c70 con 0x7f38d40d0d40 2024-05-14T15:21:37.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.795+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f38d40ca2b0 con 0x7f38b40762d0 2024-05-14T15:21:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.797+0000 7f38ca000640 1 -- 172.21.15.2:0/3747461574 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f38d40ca2b0 con 0x7f38b40762d0 2024-05-14T15:21:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.799+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f38b40762d0 msgr2=0x7f38b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.799+0000 7f38d8a00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f38b40762d0 0x7f38b40787e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f38c0034000 tx=0x7f38c002e000 comp rx=0 tx=0).stop 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.799+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 msgr2=0x7f38d40ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.799+0000 7f38d8a00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 0x7f38d40ca4d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f38c400b9f0 tx=0x7f38c400beb0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 shutdown_connections 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f38b40762d0 0x7f38b40787e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38d4163bc0 0x7f38d406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38d40d13c0 0x7f38d414de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 --2- 172.21.15.2:0/3747461574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d40d0d40 0x7f38d40ca4d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 >> 172.21.15.2:0/3747461574 conn(0x7f38d40d2bc0 msgr2=0x7f38d41623f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 shutdown_connections 2024-05-14T15:21:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:37.800+0000 7f38d8a00640 1 -- 172.21.15.2:0/3747461574 wait complete. 2024-05-14T15:21:37.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.112+0000 7f5121c00640 1 Processor -- start 2024-05-14T15:21:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.112+0000 7f5121c00640 1 -- start start 2024-05-14T15:21:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.114+0000 7f5121c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f511c06d700 0x7f511c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f5121c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c06e050 con 0x7f511c0ae750 2024-05-14T15:21:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f5121c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c1618d0 con 0x7f511c0d1050 2024-05-14T15:21:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f5121c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f511c1624e0 con 0x7f511c06d700 2024-05-14T15:21:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f5121200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f511c0ae750 0x7f511c0aeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34710/0 (socket says 172.21.15.2:34710) 2024-05-14T15:21:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f5121200640 1 -- 172.21.15.2:0/3369565251 learned_addr learned my addr 172.21.15.2:0/3369565251 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f511b400640 1 --2- 172.21.15.2:0/3369565251 >> v2:172.21.15.156:3300/0 conn(0x7f511c06d700 0x7f511c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.115+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532621872 0 0) 0x7f5114001110 con 0x7f511c0ae750 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50fc003520 con 0x7f511c0ae750 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879098575 0 0) 0x7f50fc003520 con 0x7f511c0ae750 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 >> v2:172.21.15.156:3300/0 conn(0x7f511c06d700 msgr2=0x7f511c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 --2- 172.21.15.2:0/3369565251 >> v2:172.21.15.156:3300/0 conn(0x7f511c06d700 0x7f511c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 >> v1:172.21.15.156:6789/0 conn(0x7f511c0d1050 legacy=0x7f511c070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c161bb0 con 0x7f511c0ae750 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1620957884 0 0) 0x7f51140018c0 con 0x7f511c0ae750 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 >> v1:172.21.15.2:6789/0 conn(0x7f511c0ae750 legacy=0x7f511c0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc003a50 0x7f50fc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50fc004800 0x7f50fc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50fc005250 0x7f50fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1624e0 con 0x7f50fc004800 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc00c1e0 con 0x7f50fc005250 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.116+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f50fc00c3e0 con 0x7f50fc003a50 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511b400640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50fc004800 0x7f50fc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f5121200640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50fc005250 0x7f50fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511be00640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc003a50 0x7f50fc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511b400640 1 -- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc003a50 msgr2=0x7f50fc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511b400640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc003a50 0x7f50fc003ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511b400640 1 -- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50fc005250 msgr2=0x7f50fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511b400640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50fc005250 0x7f50fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f511b400640 1 -- 172.21.15.2:0/3369565251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc003520 con 0x7f50fc004800 2024-05-14T15:21:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f5121200640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50fc005250 0x7f50fc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.117+0000 7f5121200640 1 -- 172.21.15.2:0/3369565251 reap_dead start 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.118+0000 7f511b400640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50fc004800 0x7f50fc004c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5104009fc0 tx=0x7f50fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8a570ee08d9b14 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104009c10 con 0x7f50fc004800 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5104036070 con 0x7f50fc004800 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f511aa00640 1 -- 172.21.15.2:0/3369565251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104031880 con 0x7f50fc004800 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f5121c00640 1 -- 172.21.15.2:0/3369565251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50fc004800 msgr2=0x7f50fc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f5121c00640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50fc004800 0x7f50fc004c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5104009fc0 tx=0x7f50fc005830 comp rx=0 tx=0).stop 2024-05-14T15:21:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f5121c00640 1 -- 172.21.15.2:0/3369565251 shutdown_connections 2024-05-14T15:21:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f5121c00640 1 --2- 172.21.15.2:0/3369565251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50fc004800 0x7f50fc004c10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.119+0000 7f5121c00640 1 -- 172.21.15.2:0/3369565251 >> 172.21.15.2:0/3369565251 conn(0x7f511c0732e0 msgr2=0x7f511c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.120+0000 7f5121c00640 1 -- 172.21.15.2:0/3369565251 shutdown_connections 2024-05-14T15:21:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.120+0000 7f5121c00640 1 -- 172.21.15.2:0/3369565251 wait complete. 2024-05-14T15:21:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.122+0000 7f5121c00640 1 Processor -- start 2024-05-14T15:21:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.122+0000 7f5121c00640 1 -- start start 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f5121c00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc004800 0x7f511c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f5121c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 0x7f511c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f5121c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f511c1f6680 0x7f511c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f5121c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f511c15f110 con 0x7f511c159540 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f5121c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f511c162170 con 0x7f511c1f6680 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f5121c00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f511c15f290 con 0x7f50fc004800 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f511b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 0x7f511c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f511b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 0x7f511c157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45302/0 (socket says 172.21.15.2:45302) 2024-05-14T15:21:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.124+0000 7f511b400640 1 -- 172.21.15.2:0/1844063850 learned_addr learned my addr 172.21.15.2:0/1844063850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511be00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc004800 0x7f511c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f5121200640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f511c1f6680 0x7f511c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511b400640 1 -- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc004800 msgr2=0x7f511c158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511b400640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc004800 0x7f511c158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511b400640 1 -- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f511c1f6680 msgr2=0x7f511c1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511b400640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f511c1f6680 0x7f511c1f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511b400640 1 -- 172.21.15.2:0/1844063850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c1544d0 con 0x7f511c159540 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f5121200640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f511c1f6680 0x7f511c1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f511b400640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 0x7f511c157b40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5104033040 tx=0x7f5104009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.125+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104009c10 con 0x7f511c159540 2024-05-14T15:21:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.126+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5104003990 con 0x7f511c159540 2024-05-14T15:21:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.126+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104003d80 con 0x7f511c159540 2024-05-14T15:21:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.126+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c154740 con 0x7f511c159540 2024-05-14T15:21:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.126+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c154d00 con 0x7f511c159540 2024-05-14T15:21:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.127+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511c050870 con 0x7f511c159540 2024-05-14T15:21:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.128+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5104005d10 con 0x7f511c159540 2024-05-14T15:21:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.129+0000 7f5113e00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50f80762d0 0x7f50f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.129+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f51040b8be0 con 0x7f511c159540 2024-05-14T15:21:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.130+0000 7f511be00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50f80762d0 0x7f50f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.131+0000 7f511be00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50f80762d0 0x7f50f80787e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f511c052170 tx=0x7f510c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.134+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5104082610 con 0x7f511c159540 2024-05-14T15:21:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.340+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 --> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f511c074450 con 0x7f50f80762d0 2024-05-14T15:21:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.342+0000 7f5113e00640 1 -- 172.21.15.2:0/1844063850 <== mgr.4100 v2:172.21.15.156:6832/3501490630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13380 (secure 0 0 0) 0x7f511c074450 con 0x7f50f80762d0 2024-05-14T15:21:38.343 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:38.343 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-05-14T15:21:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50f80762d0 msgr2=0x7f50f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50f80762d0 0x7f50f80787e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f511c052170 tx=0x7f510c009040 comp rx=0 tx=0).stop 2024-05-14T15:21:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 msgr2=0x7f511c157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 0x7f511c157b40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5104033040 tx=0x7f5104009750 comp rx=0 tx=0).stop 2024-05-14T15:21:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 shutdown_connections 2024-05-14T15:21:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f50f80762d0 0x7f50f80787e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f511c1f6680 0x7f511c1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c159540 0x7f511c157b40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 --2- 172.21.15.2:0/1844063850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50fc004800 0x7f511c158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 >> 172.21.15.2:0/1844063850 conn(0x7f511c0732e0 msgr2=0x7f511c152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 shutdown_connections 2024-05-14T15:21:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.345+0000 7f5121c00640 1 -- 172.21.15.2:0/1844063850 wait complete. 2024-05-14T15:21:38.371 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-05-14T15:21:36.997258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254708,"kb_used_data":5256,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720012,"statfs":{"total":773094113280,"available":772833292288,"internally_reserved":0,"allocated":5382144,"data_stored":2994904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003629"},"pg_stats":[{"pgid":"1.0","version":"45'74","reported_seq":165,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-14T15:21:32.496781+0000","last_change":"2024-05-14T15:21:32.496886+0000","last_active":"2024-05-14T15:21:32.496781+0000","last_peered":"2024-05-14T15:21:32.496781+0000","last_clean":"2024-05-14T15:21:32.496781+0000","last_became_active":"2024-05-14T15:15:38.346087+0000","last_became_peered":"2024-05-14T15:15:38.346087+0000","last_unstale":"2024-05-14T15:21:32.496781+0000","last_undegraded":"2024-05-14T15:21:32.496781+0000","last_fullsized":"2024-05-14T15:21:32.496781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'74","last_scrub_stamp":"2024-05-14T15:21:32.496580+0000","last_deep_scrub":"45'74","last_deep_scrub_stamp":"2024-05-14T15:21:32.496580+0000","last_clean_scrub_stamp":"2024-05-14T15:21:32.496580+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:31:43.512893+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1118208,"data_stored":817139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31692,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":524288,"data_stored":226771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:38.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-14T15:21:38.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.649+0000 7f6fa6a00640 1 Processor -- start 2024-05-14T15:21:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.649+0000 7f6fa6a00640 1 -- start start 2024-05-14T15:21:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6fa6a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fa00d0ff0 0x7f6fa01625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6fa6a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fa00b47e0 0x7f6fa00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6fa6a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa00b5130 con 0x7f6fa00cfb40 2024-05-14T15:21:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6fa6a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa015f5b0 con 0x7f6fa00d0ff0 2024-05-14T15:21:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6fa6a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa015e7f0 con 0x7f6fa00b47e0 2024-05-14T15:21:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6f9fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fa00d0ff0 0x7f6fa01625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6f9fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fa00d0ff0 0x7f6fa01625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45310/0 (socket says 172.21.15.2:45310) 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6f9fe00640 1 -- 172.21.15.2:0/4193471246 learned_addr learned my addr 172.21.15.2:0/4193471246 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.652+0000 7f6f97e00640 1 --2- 172.21.15.2:0/4193471246 >> v2:172.21.15.156:3300/0 conn(0x7f6fa00b47e0 0x7f6fa00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.653+0000 7f6f9fe00640 1 -- 172.21.15.2:0/4193471246 >> v2:172.21.15.156:3300/0 conn(0x7f6fa00b47e0 msgr2=0x7f6fa00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.653+0000 7f6f9fe00640 1 --2- 172.21.15.2:0/4193471246 >> v2:172.21.15.156:3300/0 conn(0x7f6fa00b47e0 0x7f6fa00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.653+0000 7f6f9fe00640 1 -- 172.21.15.2:0/4193471246 >> v1:172.21.15.156:6789/0 conn(0x7f6fa00cfb40 legacy=0x7f6fa00cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.653+0000 7f6f9fe00640 1 -- 172.21.15.2:0/4193471246 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa015ead0 con 0x7f6fa00d0ff0 2024-05-14T15:21:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.654+0000 7f6f9fe00640 1 --2- 172.21.15.2:0/4193471246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00d0ff0 0x7f6fa01625e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0073080 tx=0x7f6f9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b4eece9481fd30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.654+0000 7f6f9f400640 1 -- 172.21.15.2:0/4193471246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90037070 con 0x7f6fa00d0ff0 2024-05-14T15:21:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.654+0000 7f6f9f400640 1 -- 172.21.15.2:0/4193471246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f90032440 con 0x7f6fa00d0ff0 2024-05-14T15:21:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.654+0000 7f6f9f400640 1 -- 172.21.15.2:0/4193471246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90032810 con 0x7f6fa00d0ff0 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 -- 172.21.15.2:0/4193471246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00d0ff0 msgr2=0x7f6fa01625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/4193471246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00d0ff0 0x7f6fa01625e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0073080 tx=0x7f6f9002a1e0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 -- 172.21.15.2:0/4193471246 shutdown_connections 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/4193471246 >> v2:172.21.15.156:3300/0 conn(0x7f6fa00b47e0 0x7f6fa00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/4193471246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00d0ff0 0x7f6fa01625e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 -- 172.21.15.2:0/4193471246 >> 172.21.15.2:0/4193471246 conn(0x7f6fa00ce230 msgr2=0x7f6fa00ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 -- 172.21.15.2:0/4193471246 shutdown_connections 2024-05-14T15:21:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.655+0000 7f6fa6a00640 1 -- 172.21.15.2:0/4193471246 wait complete. 2024-05-14T15:21:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.657+0000 7f6fa6a00640 1 Processor -- start 2024-05-14T15:21:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.658+0000 7f6fa6a00640 1 -- start start 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6fa6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 0x7f6fa0070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6fa6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa00cfb40 0x7f6fa01572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6fa6a00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa00d0ff0 0x7f6fa0157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6fa6a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0071640 con 0x7f6fa00b47e0 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6fa6a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa015f090 con 0x7f6fa00cfb40 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6fa6a00640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa006d700 con 0x7f6fa00d0ff0 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6f9fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 0x7f6fa0070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6f9fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 0x7f6fa0070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45312/0 (socket says 172.21.15.2:45312) 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.659+0000 7f6f9fe00640 1 -- 172.21.15.2:0/1367193713 learned_addr learned my addr 172.21.15.2:0/1367193713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9fe00640 1 -- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa00d0ff0 msgr2=0x7f6fa0157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9fe00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa00d0ff0 0x7f6fa0157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9fe00640 1 -- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa00cfb40 msgr2=0x7f6fa01572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9fe00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa00cfb40 0x7f6fa01572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9fe00640 1 -- 172.21.15.2:0/1367193713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa01f2a50 con 0x7f6fa00b47e0 2024-05-14T15:21:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9fe00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 0x7f6fa0070b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90041020 con 0x7f6fa00b47e0 2024-05-14T15:21:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f900306c0 con 0x7f6fa00b47e0 2024-05-14T15:21:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90037040 con 0x7f6fa00b47e0 2024-05-14T15:21:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa01f2d30 con 0x7f6fa00b47e0 2024-05-14T15:21:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.660+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa01f32f0 con 0x7f6fa00b47e0 2024-05-14T15:21:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.662+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa00cf140 con 0x7f6fa00b47e0 2024-05-14T15:21:38.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.663+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6f90044020 con 0x7f6fa00b47e0 2024-05-14T15:21:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.664+0000 7f6f9cc00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6f7c076300 0x7f6f7c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.664+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f6f900b7d60 con 0x7f6fa00b47e0 2024-05-14T15:21:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.665+0000 7f6f97e00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6f7c076300 0x7f6f7c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.666+0000 7f6f97e00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6f7c076300 0x7f6f7c078810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006fd0 tx=0x7f6f88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.669+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6f9004b030 con 0x7f6fa00b47e0 2024-05-14T15:21:38.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.872+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6fa00b1800 con 0x7f6fa00b47e0 2024-05-14T15:21:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.879+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f6fa00b5130 con 0x7f6fa00b47e0 2024-05-14T15:21:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.882+0000 7f6f9cc00640 1 -- 172.21.15.2:0/1367193713 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f90080ba0 con 0x7f6fa00b47e0 2024-05-14T15:21:38.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.883+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6f7c076300 msgr2=0x7f6f7c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.883+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6f7c076300 0x7f6f7c078810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006fd0 tx=0x7f6f88008040 comp rx=0 tx=0).stop 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.883+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 msgr2=0x7f6fa0070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.883+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 0x7f6fa0070b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f900046c0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 shutdown_connections 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f6f7c076300 0x7f6f7c078810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa00cfb40 0x7f6fa01572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa00d0ff0 0x7f6fa0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 --2- 172.21.15.2:0/1367193713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b47e0 0x7f6fa0070b60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 >> 172.21.15.2:0/1367193713 conn(0x7f6fa00ce230 msgr2=0x7f6fa0158170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 shutdown_connections 2024-05-14T15:21:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:38.884+0000 7f6fa6a00640 1 -- 172.21.15.2:0/1367193713 wait complete. 2024-05-14T15:21:38.911 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T15:21:38.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T15:21:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.184+0000 7f27cf200640 1 Processor -- start 2024-05-14T15:21:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.184+0000 7f27cf200640 1 -- start start 2024-05-14T15:21:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.186+0000 7f27cf200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27d00cf3c0 0x7f27d00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.186+0000 7f27cf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d00d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.186+0000 7f27cf200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d00d2f30 con 0x7f27d0163d90 2024-05-14T15:21:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.186+0000 7f27cf200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 -- 0x7f27d00af400 con 0x7f27d00cf3c0 2024-05-14T15:21:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.186+0000 7f27cf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f27d00cfe40 con 0x7f27d00d25e0 2024-05-14T15:21:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.187+0000 7f27cde00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27d00cf3c0 0x7f27d00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.187+0000 7f27c7e00640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d00d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.187+0000 7f27cde00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27d00cf3c0 0x7f27d00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.2:50072/0 (socket says 172.21.15.2:50072) 2024-05-14T15:21:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.187+0000 7f27cde00640 1 -- 172.21.15.2:0/1641418198 learned_addr learned my addr 172.21.15.2:0/1641418198 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.187+0000 7f27ce800640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f27d0163d90 0x7f27d01641a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.2:46954/0 (socket says 172.21.15.2:46954) 2024-05-14T15:21:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.188+0000 7f27cde00640 1 -- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 msgr2=0x7f27d00d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.188+0000 7f27cde00640 1 --2- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d00d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.188+0000 7f27cde00640 1 -- 172.21.15.2:0/1641418198 >> v1:172.21.15.156:6789/0 conn(0x7f27d0163d90 legacy=0x7f27d01641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.188+0000 7f27cde00640 1 -- 172.21.15.2:0/1641418198 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d00af650 con 0x7f27d00cf3c0 2024-05-14T15:21:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.188+0000 7f27c7e00640 1 --2- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d00d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:21:39.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.189+0000 7f27cde00640 1 --2- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d00cf3c0 0x7f27d00cf7d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009870 tx=0x7f27c002a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7753f452747f607 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:39.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.190+0000 7f27cd400640 1 -- 172.21.15.2:0/1641418198 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0037070 con 0x7f27d00cf3c0 2024-05-14T15:21:39.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.190+0000 7f27cd400640 1 -- 172.21.15.2:0/1641418198 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f27c0032440 con 0x7f27d00cf3c0 2024-05-14T15:21:39.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.190+0000 7f27cd400640 1 -- 172.21.15.2:0/1641418198 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0032830 con 0x7f27d00cf3c0 2024-05-14T15:21:39.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 -- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d00cf3c0 msgr2=0x7f27d00cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 --2- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d00cf3c0 0x7f27d00cf7d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009870 tx=0x7f27c002a1d0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 -- 172.21.15.2:0/1641418198 shutdown_connections 2024-05-14T15:21:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 --2- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d00d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 --2- 172.21.15.2:0/1641418198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d00cf3c0 0x7f27d00cf7d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 -- 172.21.15.2:0/1641418198 >> 172.21.15.2:0/1641418198 conn(0x7f27d009b410 msgr2=0x7f27d009b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 -- 172.21.15.2:0/1641418198 shutdown_connections 2024-05-14T15:21:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.191+0000 7f27cf200640 1 -- 172.21.15.2:0/1641418198 wait complete. 2024-05-14T15:21:39.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.193+0000 7f27cf200640 1 Processor -- start 2024-05-14T15:21:39.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.194+0000 7f27cf200640 1 -- start start 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.195+0000 7f27cf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 0x7f27d015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.195+0000 7f27cf200640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d0155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.195+0000 7f27cf200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d0163d90 0x7f27d01576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.195+0000 7f27cf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27d006f490 con 0x7f27d00cf3c0 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.195+0000 7f27cf200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f27d00afc10 con 0x7f27d0163d90 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.195+0000 7f27cf200640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 -- 0x7f27d006f610 con 0x7f27d00d25e0 2024-05-14T15:21:39.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 0x7f27d015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 0x7f27d015f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45326/0 (socket says 172.21.15.2:45326) 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 -- 172.21.15.2:0/3818454290 learned_addr learned my addr 172.21.15.2:0/3818454290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27c7e00640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d0155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27ce800640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d0163d90 0x7f27d01576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 -- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 msgr2=0x7f27d0155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d0155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 -- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d0163d90 msgr2=0x7f27d01576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d0163d90 0x7f27d01576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.196+0000 7f27cde00640 1 -- 172.21.15.2:0/3818454290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d00c9c50 con 0x7f27d00cf3c0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.197+0000 7f27cde00640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 0x7f27d015f5c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f27c002a210 tx=0x7f27c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.197+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0037040 con 0x7f27d00cf3c0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.197+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f27c0042070 con 0x7f27d00cf3c0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.197+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d00c9f30 con 0x7f27d00cf3c0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.197+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0030920 con 0x7f27d00cf3c0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.197+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d00ca4f0 con 0x7f27d00cf3c0 2024-05-14T15:21:39.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.198+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d0050870 con 0x7f27d00cf3c0 2024-05-14T15:21:39.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.199+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f27c0030ac0 con 0x7f27d00cf3c0 2024-05-14T15:21:39.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.201+0000 7f27c6000640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f27ac076300 0x7f27ac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.201+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f27c00b7f50 con 0x7f27d00cf3c0 2024-05-14T15:21:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.201+0000 7f27c7e00640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f27ac076300 0x7f27ac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.203+0000 7f27c7e00640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f27ac076300 0x7f27ac078810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f27d006d9e0 tx=0x7f27b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:39.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.205+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f27c00818f0 con 0x7f27d00cf3c0 2024-05-14T15:21:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.457+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27d00cf1a0 con 0x7f27d00cf3c0 2024-05-14T15:21:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.459+0000 7f27c6000640 1 -- 172.21.15.2:0/3818454290 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3866 (secure 0 0 0) 0x7f27c00811f0 con 0x7f27d00cf3c0 2024-05-14T15:21:39.459 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-05-14T15:21:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3133431075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6835","nonce":3133431075},{"type":"v1","addr":"172.21.15.156:6837","nonce":3133431075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6836/4127554657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4127554657},{"type":"v1","addr":"172.21.15.156:6836","nonce":4127554657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3273261471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3273261471},{"type":"v1","addr":"172.21.15.2:6833","nonce":3273261471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/157851207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":157851207},{"type":"v1","addr":"172.21.15.2:6835","nonce":157851207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-05-14T15:21:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-05-14T15:21:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f27ac076300 msgr2=0x7f27ac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f27ac076300 0x7f27ac078810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f27d006d9e0 tx=0x7f27b8008040 comp rx=0 tx=0).stop 2024-05-14T15:21:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 msgr2=0x7f27d015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 0x7f27d015f5c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f27c002a210 tx=0x7f27c00046c0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 shutdown_connections 2024-05-14T15:21:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:6832/3501490630,v1:172.21.15.156:6833/3501490630] conn(0x7f27ac076300 0x7f27ac078810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27d0163d90 0x7f27d01576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27d00d25e0 0x7f27d0155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 --2- 172.21.15.2:0/3818454290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d00cf3c0 0x7f27d015f5c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 >> 172.21.15.2:0/3818454290 conn(0x7f27d009b410 msgr2=0x7f27d0158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 shutdown_connections 2024-05-14T15:21:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-05-14T15:21:39.462+0000 7f27cf200640 1 -- 172.21.15.2:0/3818454290 wait complete. 2024-05-14T15:21:39.488 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-14T15:21:39.488 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-14T15:21:39.488 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-14T15:21:39.488 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.516 INFO:tasks.ceph.mds.a:Stopped 2024-05-14T15:21:39.516 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-14T15:21:39.517 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.610 INFO:tasks.ceph.mds.c:Stopped 2024-05-14T15:21:39.610 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-14T15:21:39.610 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.666 INFO:tasks.ceph.mds.b:Stopped 2024-05-14T15:21:39.666 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-14T15:21:39.666 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.699 INFO:tasks.ceph.mds.d:Stopped 2024-05-14T15:21:39.699 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-14T15:21:39.699 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-14T15:21:39.699 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.786 INFO:tasks.ceph.osd.0:Stopped 2024-05-14T15:21:39.786 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-14T15:21:39.786 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.862 INFO:tasks.ceph.osd.1:Stopped 2024-05-14T15:21:39.862 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-14T15:21:39.862 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:39.944 INFO:tasks.ceph.osd.2:Stopped 2024-05-14T15:21:39.944 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-14T15:21:39.944 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:40.023 INFO:tasks.ceph.osd.3:Stopped 2024-05-14T15:21:40.024 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-14T15:21:40.024 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:40.122 INFO:tasks.ceph.osd.4:Stopped 2024-05-14T15:21:40.123 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-14T15:21:40.123 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:40.197 INFO:tasks.ceph.osd.5:Stopped 2024-05-14T15:21:40.198 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-14T15:21:40.198 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:40.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-14T15:21:40.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-14T15:21:40.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-14T15:21:40.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-14T15:21:40.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-14T15:21:42.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:21:42.157 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:21:46.299 INFO:tasks.ceph.osd.6:Stopped 2024-05-14T15:21:46.300 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-14T15:21:46.300 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:46.384 INFO:tasks.ceph.osd.7:Stopped 2024-05-14T15:21:46.384 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-14T15:21:46.385 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-14T15:21:46.385 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:46.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-14T15:21:46.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-14T15:21:46.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-14T15:21:46.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-14T15:21:46.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-14T15:21:46.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-14T15:21:51.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-05-14T15:21:51.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-14T15:21:52.487 INFO:tasks.ceph.mgr.y:Stopped 2024-05-14T15:21:52.487 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-14T15:21:52.488 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:52.582 INFO:tasks.ceph.mgr.x:Stopped 2024-05-14T15:21:52.583 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-14T15:21:52.583 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-14T15:21:52.583 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:52.628 INFO:tasks.ceph.mon.a:Stopped 2024-05-14T15:21:52.629 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-14T15:21:52.629 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:52.668 INFO:tasks.ceph.mon.b:Stopped 2024-05-14T15:21:52.668 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-14T15:21:52.668 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:21:56.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-14T15:21:56.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-05-14T15:21:58.770 INFO:tasks.ceph.mon.c:Stopped 2024-05-14T15:21:58.770 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-14T15:21:58.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-14T15:21:58.879 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:21:58.879 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-14T15:21:59.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:21:59.199 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-14T15:21:59.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:21:59.337 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-14T15:21:59.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:21:59.467 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-14T15:21:59.616 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:21:59.616 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-14T15:21:59.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:21:59.826 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-14T15:21:59.964 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:21:59.964 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-14T15:22:00.114 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:22:00.114 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-14T15:22:00.288 INFO:tasks.ceph:Archiving mon data... 2024-05-14T15:22:00.290 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/data/mon.a.tgz 2024-05-14T15:22:00.290 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-05-14T15:22:00.350 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.gd6FiDwVCx 2024-05-14T15:22:00.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gd6FiDwVCx 2024-05-14T15:22:00.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.gd6FiDwVCx 2024-05-14T15:22:00.679 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.gd6FiDwVCx is 342KB 2024-05-14T15:22:00.793 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.gd6FiDwVCx 2024-05-14T15:22:00.852 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/data/mon.b.tgz 2024-05-14T15:22:00.853 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-05-14T15:22:00.911 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.YWczNoN2SP 2024-05-14T15:22:00.911 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.YWczNoN2SP 2024-05-14T15:22:01.114 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.YWczNoN2SP 2024-05-14T15:22:01.257 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.YWczNoN2SP is 458KB 2024-05-14T15:22:01.370 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.YWczNoN2SP 2024-05-14T15:22:01.425 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/data/mon.c.tgz 2024-05-14T15:22:01.426 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-05-14T15:22:01.473 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.cp9Page4qG 2024-05-14T15:22:01.474 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cp9Page4qG 2024-05-14T15:22:01.706 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.cp9Page4qG 2024-05-14T15:22:01.841 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.cp9Page4qG is 458KB 2024-05-14T15:22:01.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-14T15:22:01.947 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.cp9Page4qG 2024-05-14T15:22:02.003 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-14T15:22:02.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-14T15:22:02.011 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-14T15:22:02.152 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-14T15:22:02.211 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-14T15:22:02.211 INFO:tasks.ceph:Archiving crash dumps... 2024-05-14T15:22:02.213 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/remote/smithi002/crash 2024-05-14T15:22:02.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-14T15:22:02.304 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/remote/smithi156/crash 2024-05-14T15:22:02.305 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-14T15:22:02.382 INFO:tasks.ceph:Shutting down logrotate 2024-05-14T15:22:02.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:22:02.389 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:22:02.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-14T15:22:02.603 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-14T15:22:02.691 INFO:tasks.ceph:Compressing logs... 2024-05-14T15:22:02.691 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T15:22:02.699 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T15:22:02.778 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36969.log 2024-05-14T15:22:02.779 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-14T15:22:02.780 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.36969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-05-14T15:22:02.780 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36969.log.gz 2024-05-14T15:22:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40993.log 2024-05-14T15:22:02.781 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36889.log 2024-05-14T15:22:02.782 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104067.log 2024-05-14T15:22:02.782 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41381.log 2024-05-14T15:22:02.782 INFO:teuthology.orchestra.run.smithi156.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-14T15:22:02.783 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47052.log/var/log/ceph/ceph-client.admin.40993.log: 2024-05-14T15:22:02.783 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-05-14T15:22:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104067.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40993.log.gz 2024-05-14T15:22:02.784 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.36889.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36889.log.gz 2024-05-14T15:22:02.784 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41904.log 2024-05-14T15:22:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104067.log.gz 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47052.log.gz 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.1.41381.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.1.41381.log.gz 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.3.41904.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-14T15:22:02.786 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.3.41904.log.gz 2024-05-14T15:22:02.788 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-14T15:22:02.788 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-14T15:22:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40739.log 2024-05-14T15:22:02.788 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-05-14T15:22:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104664.log 2024-05-14T15:22:02.788 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2024-05-14T15:22:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36217.log 2024-05-14T15:22:02.789 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40739.log.gz 2024-05-14T15:22:02.790 INFO:teuthology.orchestra.run.smithi156.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-14T15:22:02.790 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36718.log 2024-05-14T15:22:02.791 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-14T15:22:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104339.log 2024-05-14T15:22:02.791 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104664.log.gz 2024-05-14T15:22:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40341.log 2024-05-14T15:22:02.791 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36217.log.gz 2024-05-14T15:22:02.792 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104296.log 2024-05-14T15:22:02.792 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104339.log.gz 2024-05-14T15:22:02.792 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.36718.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36718.log.gz 2024-05-14T15:22:02.793 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37009.log 2024-05-14T15:22:02.793 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-14T15:22:02.794 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.37009.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37009.log.gz 2024-05-14T15:22:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45164.log 2024-05-14T15:22:02.794 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40341.log.gz 2024-05-14T15:22:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104296.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104296.log.gz 2024-05-14T15:22:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46151.log 2024-05-14T15:22:02.795 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-14T15:22:02.795 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-14T15:22:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2024-05-14T15:22:02.796 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45164.log.gz 2024-05-14T15:22:02.796 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40951.log 2024-05-14T15:22:02.796 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46151.log.gz 2024-05-14T15:22:02.797 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40867.log 2024-05-14T15:22:02.797 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2024-05-14T15:22:02.798 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36849.log 2024-05-14T15:22:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2024-05-14T15:22:02.799 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40951.log.gz 2024-05-14T15:22:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45511.log 2024-05-14T15:22:02.799 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40867.log.gz 2024-05-14T15:22:02.800 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.36849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36849.log.gz 2024-05-14T15:22:02.801 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-05-14T15:22:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46575.log 2024-05-14T15:22:02.802 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2024-05-14T15:22:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40611.log 2024-05-14T15:22:02.802 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45511.log.gz 2024-05-14T15:22:02.803 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.36809.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-14T15:22:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2024-05-14T15:22:02.804 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46575.log.gz 2024-05-14T15:22:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2024-05-14T15:22:02.804 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2024-05-14T15:22:02.805 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2024-05-14T15:22:02.805 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2024-05-14T15:22:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-05-14T15:22:02.807 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2024-05-14T15:22:02.807 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.d.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-05-14T15:22:02.807 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-14T15:22:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43851.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2024-05-14T15:22:02.808 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104843.log 2024-05-14T15:22:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104381.log 2024-05-14T15:22:02.810 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2024-05-14T15:22:02.810 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz 2024-05-14T15:22:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-05-14T15:22:02.810 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104843.log.gz 2024-05-14T15:22:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47838.log 2024-05-14T15:22:02.811 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104381.log.gz 2024-05-14T15:22:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45416.log 2024-05-14T15:22:02.812 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-05-14T15:22:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.47838.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-14T15:22:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43597.log 2024-05-14T15:22:02.814 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45416.log.gz 2024-05-14T15:22:02.815 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-05-14T15:22:02.815 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.b.log: 92.4%/var/log/ceph/ceph-client.admin.36764.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz 2024-05-14T15:22:02.815 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-14T15:22:02.816 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40783.log 2024-05-14T15:22:02.816 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43597.log.gz 2024-05-14T15:22:02.816 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-14T15:22:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2024-05-14T15:22:02.817 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-05-14T15:22:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40783.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40783.log.gz 2024-05-14T15:22:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2024-05-14T15:22:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45374.log 2024-05-14T15:22:02.820 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2024-05-14T15:22:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45899.log: 95.5% -- replaced with /var/log/ceph/ceph-client.0.47838.log.gz 2024-05-14T15:22:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2024-05-14T15:22:02.820 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2024-05-14T15:22:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45374.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-14T15:22:02.821 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45374.log.gz 2024-05-14T15:22:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46495.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz 2024-05-14T15:22:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2024-05-14T15:22:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40655.log 2024-05-14T15:22:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104927.log 2024-05-14T15:22:02.825 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2024-05-14T15:22:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44261.log 2024-05-14T15:22:02.826 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40655.log.gz 2024-05-14T15:22:02.827 INFO:teuthology.orchestra.run.smithi156.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-14T15:22:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46871.log 2024-05-14T15:22:02.827 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104927.log.gz 2024-05-14T15:22:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.44261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-05-14T15:22:02.829 INFO:teuthology.orchestra.run.smithi002.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.44261.log.gz 2024-05-14T15:22:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45569.log 2024-05-14T15:22:02.830 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46871.log.gz 2024-05-14T15:22:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46703.log 2024-05-14T15:22:02.831 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-05-14T15:22:02.832 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45569.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-14T15:22:02.832 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45569.log.gz 2024-05-14T15:22:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-05-14T15:22:02.833 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46703.log.gz 2024-05-14T15:22:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104025.log 2024-05-14T15:22:02.835 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43231.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-14T15:22:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45248.log 2024-05-14T15:22:02.836 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-05-14T15:22:02.836 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104759.log 2024-05-14T15:22:02.837 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104025.log.gz 2024-05-14T15:22:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42895.log 2024-05-14T15:22:02.838 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45248.log.gz 2024-05-14T15:22:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2024-05-14T15:22:02.839 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104759.log.gz 2024-05-14T15:22:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40697.log 2024-05-14T15:22:02.840 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42895.log.gz 2024-05-14T15:22:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104801.log 2024-05-14T15:22:02.841 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2024-05-14T15:22:02.842 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105095.log 2024-05-14T15:22:02.842 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40697.log.gz 2024-05-14T15:22:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-05-14T15:22:02.843 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104801.log.gz 2024-05-14T15:22:02.844 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2024-05-14T15:22:02.844 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105095.log.gz 2024-05-14T15:22:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-05-14T15:22:02.845 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-05-14T15:22:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2024-05-14T15:22:02.846 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2024-05-14T15:22:02.847 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2024-05-14T15:22:02.847 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-05-14T15:22:02.848 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2024-05-14T15:22:02.848 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2024-05-14T15:22:02.849 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2024-05-14T15:22:02.849 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2024-05-14T15:22:02.850 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47094.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2024-05-14T15:22:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-14T15:22:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2024-05-14T15:22:02.852 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2024-05-14T15:22:02.853 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2024-05-14T15:22:02.854 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42893.log 2024-05-14T15:22:02.854 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2024-05-14T15:22:02.856 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-05-14T15:22:02.856 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2024-05-14T15:22:02.857 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104193.log 2024-05-14T15:22:02.857 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42893.log.gz 2024-05-14T15:22:02.858 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46109.log 2024-05-14T15:22:02.858 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz 2024-05-14T15:22:02.859 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2024-05-14T15:22:02.859 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104193.log.gz 2024-05-14T15:22:02.861 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42897.log 2024-05-14T15:22:02.861 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46109.log.gz 2024-05-14T15:22:02.861 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41143.log 2024-05-14T15:22:02.862 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2024-05-14T15:22:02.863 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42897.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-14T15:22:02.863 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42897.log.gz 2024-05-14T15:22:02.864 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2024-05-14T15:22:02.864 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41143.log.gz 2024-05-14T15:22:02.865 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104254.log 2024-05-14T15:22:02.866 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2024-05-14T15:22:02.866 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105179.log 2024-05-14T15:22:02.867 INFO:teuthology.orchestra.run.smithi002.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-14T15:22:02.868 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2024-05-14T15:22:02.868 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104254.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104254.log.gz 2024-05-14T15:22:02.869 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43471.log 2024-05-14T15:22:02.869 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105179.log.gz 2024-05-14T15:22:02.870 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44838.log 2024-05-14T15:22:02.870 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2024-05-14T15:22:02.871 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40567.log 2024-05-14T15:22:02.872 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43471.log.gz 2024-05-14T15:22:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.2.44838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42884.log 2024-05-14T15:22:02.874 INFO:teuthology.orchestra.run.smithi002.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.2.44838.log.gz 2024-05-14T15:22:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40567.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-14T15:22:02.875 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40567.log.gz 2024-05-14T15:22:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42884.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-14T15:22:02.876 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42884.log.gz 2024-05-14T15:22:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42882.log 2024-05-14T15:22:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-14T15:22:02.879 INFO:teuthology.orchestra.run.smithi156.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-14T15:22:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.42882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42337.log 2024-05-14T15:22:02.880 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42882.log.gz 2024-05-14T15:22:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104717.log 2024-05-14T15:22:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43193.log 2024-05-14T15:22:02.883 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42337.log.gz 2024-05-14T15:22:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2024-05-14T15:22:02.884 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104717.log.gz 2024-05-14T15:22:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43193.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.43220.log 2024-05-14T15:22:02.885 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43193.log.gz 2024-05-14T15:22:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46067.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2024-05-14T15:22:02.887 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-14T15:22:02.888 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43220.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2024-05-14T15:22:02.888 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40521.log 2024-05-14T15:22:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104885.log 2024-05-14T15:22:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105305.log 2024-05-14T15:22:02.892 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40521.log.gz 2024-05-14T15:22:02.893 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104621.log 2024-05-14T15:22:02.893 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104885.log.gz 2024-05-14T15:22:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40825.log 2024-05-14T15:22:02.894 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105305.log.gz 2024-05-14T15:22:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-05-14T15:22:02.895 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104621.log.gz 2024-05-14T15:22:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-05-14T15:22:02.897 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40825.log.gz 2024-05-14T15:22:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2024-05-14T15:22:02.898 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-05-14T15:22:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40457.log 2024-05-14T15:22:02.899 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-05-14T15:22:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105471.log 2024-05-14T15:22:02.901 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2024-05-14T15:22:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40457.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-14T15:22:02.902 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40457.log.gz 2024-05-14T15:22:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103941.log 2024-05-14T15:22:02.903 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105471.log.gz 2024-05-14T15:22:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2024-05-14T15:22:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.103941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42025.log 2024-05-14T15:22:02.906 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103941.log.gz 2024-05-14T15:22:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46415.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2024-05-14T15:22:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2024-05-14T15:22:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42025.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42025.log.gz 2024-05-14T15:22:02.909 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104537.log 2024-05-14T15:22:02.910 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42193.log 2024-05-14T15:22:02.910 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2024-05-14T15:22:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104537.log.gz 2024-05-14T15:22:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42193.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42193.log.gz 2024-05-14T15:22:02.914 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47242.log 2024-05-14T15:22:02.915 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45206.log 2024-05-14T15:22:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47242.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46957.log 2024-05-14T15:22:02.917 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47242.log.gz 2024-05-14T15:22:02.918 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41077.log 2024-05-14T15:22:02.918 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45206.log.gz 2024-05-14T15:22:02.920 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46957.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46957.log.gz 2024-05-14T15:22:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42559.log 2024-05-14T15:22:02.921 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43555.log 2024-05-14T15:22:02.922 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41077.log.gz 2024-05-14T15:22:02.923 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-05-14T15:22:02.923 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42559.log.gz 2024-05-14T15:22:02.924 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43555.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43555.log.gz 2024-05-14T15:22:02.925 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47140.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-05-14T15:22:02.926 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-05-14T15:22:02.928 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30189.log 2024-05-14T15:22:02.929 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46787.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43513.log 2024-05-14T15:22:02.929 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2024-05-14T15:22:02.930 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.30189.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103983.log 2024-05-14T15:22:02.930 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.30189.log.gz 2024-05-14T15:22:02.931 INFO:teuthology.orchestra.run.smithi156.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-14T15:22:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43513.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43513.log.gz 2024-05-14T15:22:02.932 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42896.log 2024-05-14T15:22:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.103983.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103983.log.gz 2024-05-14T15:22:02.933 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45941.log 2024-05-14T15:22:02.935 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42547.log 2024-05-14T15:22:02.935 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2024-05-14T15:22:02.936 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45941.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45941.log.gz 2024-05-14T15:22:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42547.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42547.log.gz 2024-05-14T15:22:02.938 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41596.log 2024-05-14T15:22:02.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105263.log 2024-05-14T15:22:02.942 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67087.log 2024-05-14T15:22:02.942 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105263.log.gz 2024-05-14T15:22:02.943 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.67087.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.41596.log.gz 2024-05-14T15:22:02.943 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67087.log.gz 2024-05-14T15:22:02.944 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-05-14T15:22:02.945 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46286.log 2024-05-14T15:22:02.947 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2024-05-14T15:22:02.947 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-05-14T15:22:02.948 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46286.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46286.log.gz 2024-05-14T15:22:02.949 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2024-05-14T15:22:02.950 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41983.log 2024-05-14T15:22:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2024-05-14T15:22:02.953 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46913.log 2024-05-14T15:22:02.953 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41983.log.gz 2024-05-14T15:22:02.954 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42556.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2024-05-14T15:22:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46913.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46913.log.gz 2024-05-14T15:22:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41805.log 2024-05-14T15:22:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105011.log 2024-05-14T15:22:02.958 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42561.log 2024-05-14T15:22:02.959 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41805.log.gz 2024-05-14T15:22:02.960 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105011.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105011.log.gz 2024-05-14T15:22:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42561.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42561.log.gz 2024-05-14T15:22:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104151.log 2024-05-14T15:22:02.963 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2024-05-14T15:22:02.964 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2024-05-14T15:22:02.964 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104151.log.gz 2024-05-14T15:22:02.966 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47001.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2024-05-14T15:22:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41941.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2024-05-14T15:22:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42379.log 2024-05-14T15:22:02.969 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66516.log 2024-05-14T15:22:02.970 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2024-05-14T15:22:02.970 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42379.log.gz 2024-05-14T15:22:02.972 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66516.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66516.log.gz 2024-05-14T15:22:02.973 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42560.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2024-05-14T15:22:02.973 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2024-05-14T15:22:02.974 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105389.log 2024-05-14T15:22:02.976 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104969.log 2024-05-14T15:22:02.976 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2024-05-14T15:22:02.977 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105389.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105389.log.gz 2024-05-14T15:22:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104969.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104969.log.gz 2024-05-14T15:22:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2024-05-14T15:22:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45983.log 2024-05-14T15:22:02.982 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42253.log 2024-05-14T15:22:02.982 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2024-05-14T15:22:02.984 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45983.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45983.log.gz 2024-05-14T15:22:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42253.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42253.log.gz 2024-05-14T15:22:02.985 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43723.log 2024-05-14T15:22:02.987 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105053.log 2024-05-14T15:22:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43723.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43723.log.gz 2024-05-14T15:22:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-05-14T15:22:02.990 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40909.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105053.log.gz 2024-05-14T15:22:02.990 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-05-14T15:22:02.992 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz/var/log/ceph/ceph-client.admin.40909.log: 2024-05-14T15:22:02.993 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2024-05-14T15:22:02.993 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.46829.log 2024-05-14T15:22:02.995 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2024-05-14T15:22:02.996 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46829.log.gz 2024-05-14T15:22:02.997 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105347.log 2024-05-14T15:22:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45290.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2024-05-14T15:22:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105347.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105347.log.gz 2024-05-14T15:22:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105429.log 2024-05-14T15:22:03.002 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2024-05-14T15:22:03.003 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105429.log.gz 2024-05-14T15:22:03.003 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2024-05-14T15:22:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2024-05-14T15:22:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.46025.log: --verbose -- /var/log/ceph/ceph-client.admin.104109.log 2024-05-14T15:22:03.006 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz 2024-05-14T15:22:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-05-14T15:22:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104109.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104109.log.gz 2024-05-14T15:22:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-14T15:22:03.011 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42544.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2024-05-14T15:22:03.011 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-mds.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2024-05-14T15:22:03.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-05-14T15:22:03.016 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2024-05-14T15:22:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105221.log 2024-05-14T15:22:03.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42109.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-05-14T15:22:03.022 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 2024-05-14T15:22:03.023 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105221.log.gz 2024-05-14T15:22:03.025 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104579.log 2024-05-14T15:22:03.027 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47410.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-05-14T15:22:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105137.log 2024-05-14T15:22:03.031 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104579.log.gz 2024-05-14T15:22:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-05-14T15:22:03.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105137.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105137.log.gz 2024-05-14T15:22:03.036 INFO:teuthology.orchestra.run.smithi156.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-14T15:22:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40245.log 2024-05-14T15:22:03.039 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-05-14T15:22:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-05-14T15:22:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40245.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40245.log.gz 2024-05-14T15:22:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103899.log 2024-05-14T15:22:03.047 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip 88.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-05-14T15:22:03.048 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.103899.log: -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-05-14T15:22:03.048 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103899.log.gz 2024-05-14T15:22:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47284.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-05-14T15:22:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-05-14T15:22:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41035.log 2024-05-14T15:22:03.056 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-05-14T15:22:03.059 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41035.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41035.log.gz 2024-05-14T15:22:03.072 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-14T15:22:03.340 INFO:teuthology.orchestra.run.smithi002.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-14T15:22:03.542 INFO:teuthology.orchestra.run.smithi156.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-14T15:22:03.573 INFO:teuthology.orchestra.run.smithi156.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-14T15:22:03.588 INFO:teuthology.orchestra.run.smithi156.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-14T15:22:03.619 INFO:teuthology.orchestra.run.smithi156.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-14T15:22:03.623 INFO:teuthology.orchestra.run.smithi156.stderr: 2024-05-14T15:22:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m0.874s 2024-05-14T15:22:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:user 0m3.382s 2024-05-14T15:22:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m0.377s 2024-05-14T15:22:03.653 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-14T15:22:03.699 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-14T15:22:03.710 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-14T15:22:03.814 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-14T15:22:03.818 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-05-14T15:22:03.818 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m1.070s 2024-05-14T15:22:03.819 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m3.771s 2024-05-14T15:22:03.819 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.785s 2024-05-14T15:22:03.819 INFO:tasks.ceph:Archiving logs... 2024-05-14T15:22:03.820 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/remote/smithi002/log 2024-05-14T15:22:03.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T15:22:04.504 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/remote/smithi156/log 2024-05-14T15:22:04.505 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T15:22:05.030 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-14T15:22:05.039 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-14T15:22:05.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T15:22:05.047 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T15:22:05.195 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-14T15:22:05.204 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-14T15:22:05.204 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:22:05.212 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:22:05.263 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:22:05.268 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:22:05.273 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:22:05.274 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-05-14T15:22:05.274 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +778us[ +779us] +/- 52ms 2024-05-14T15:22:05.274 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -868us[ -868us] +/- 57ms 2024-05-14T15:22:05.274 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -78us[ -78us] +/- 86ms 2024-05-14T15:22:05.274 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:22:05.278 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:22:05.278 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-05-14T15:22:05.278 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +782us[ +787us] +/- 53ms 2024-05-14T15:22:05.278 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -844us[ -844us] +/- 57ms 2024-05-14T15:22:05.278 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -15us[ -10us] +/- 86ms 2024-05-14T15:22:05.278 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:22:05.280 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-14T15:22:05.288 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-14T15:22:05.289 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-14T15:22:05.307 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T15:22:05.491 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T15:22:05.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T15:22:05.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:22:05.787 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T15:22:05.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:22:05.881 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-14T15:22:05.892 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-14T15:22:05.933 INFO:teuthology.task.internal:Duration was 953.422963 seconds 2024-05-14T15:22:05.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-14T15:22:05.967 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-14T15:22:05.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T15:22:05.975 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T15:22:06.110 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T15:22:06.121 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T15:22:06.385 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-14T15:22:06.385 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-05-14T15:22:06.386 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T15:22:06.454 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2024-05-14T15:22:06.454 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T15:22:06.535 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-14T15:22:06.536 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T15:22:06.544 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T15:22:06.632 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-14T15:22:06.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T15:22:06.637 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T15:22:06.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-14T15:22:06.828 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-14T15:22:06.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T15:22:06.918 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T15:22:07.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-14T15:22:07.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T15:22:07.019 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T15:22:07.118 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2024-05-14T15:22:07.120 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-05-14T15:22:07.166 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T15:22:07.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:22:07.216 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T15:22:07.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:22:07.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-14T15:22:07.281 INFO:teuthology.task.internal:Transferring archived files... 2024-05-14T15:22:07.282 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/remote/smithi002 2024-05-14T15:22:07.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T15:22:07.384 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883/remote/smithi156 2024-05-14T15:22:07.384 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T15:22:07.480 INFO:teuthology.task.internal:Removing archive directory... 2024-05-14T15:22:07.480 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T15:22:07.489 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T15:22:07.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-14T15:22:07.556 INFO:teuthology.task.internal:Not uploading archives. 2024-05-14T15:22:07.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-14T15:22:07.585 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-14T15:22:07.586 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T15:22:07.593 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T15:22:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: 393249 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 14 15:22 /home/ubuntu/cephtest 2024-05-14T15:22:07.646 INFO:teuthology.orchestra.run.smithi002.stdout: 527382 4 d--------- 2 ubuntu ubuntu 4096 May 14 15:17 /home/ubuntu/cephtest/mnt.0 2024-05-14T15:22:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-05-14T15:22:07.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T15:22:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-05-14T15:22:07.650 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-14T15:22:07.651 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-14T15:22:07.661 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-14T15:22:07.684 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi002 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-14T15:22:07.685 INFO:teuthology.nuke:Checking targets against current locks 2024-05-14T15:22:07.689 INFO:teuthology.orchestra.run.smithi156.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 15:22 /home/ubuntu/cephtest 2024-05-14T15:22:07.709 DEBUG:teuthology.nuke:shortname: smithi002 2024-05-14T15:22:07.710 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T15:22:07.732 DEBUG:teuthology.nuke:shortname: smithi156 2024-05-14T15:22:07.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T15:22:07.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:57:07.050153', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJDctHgxwxwdmTHmBMSuDYiAAHjOFRysYfTeXT88sKgqy1bX5giYi4SFsduoFT5no2/y3ZbUrKY3Zxl6V9tuoHk='} 2024-05-14T15:22:07.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:57:07.048192', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5vZrVO7H7YxUnZ537Mogs9gMThAxjOPrnTcNUpN6OpwsCfy8kYIFO1uRdyTD6lftYqIX6Exc1Ke+NKu2ixNzc='} 2024-05-14T15:22:07.786 INFO:teuthology.orchestra.console.smithi002:Power off 2024-05-14T15:22:07.786 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T15:22:07.810 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2024-05-14T15:22:07.810 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:07.824 INFO:teuthology.orchestra.console.smithi156:Power off 2024-05-14T15:22:07.824 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T15:22:07.834 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2024-05-14T15:22:07.848 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-05-14T15:22:07.848 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:07.870 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-05-14T15:22:11.835 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:11.871 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:11.945 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2024-05-14T15:22:11.981 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-05-14T15:22:15.948 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:15.982 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:16.059 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2024-05-14T15:22:16.094 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-05-14T15:22:16.160 INFO:teuthology.orchestra.console.smithi002:Power off completed 2024-05-14T15:22:20.095 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T15:22:20.206 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-05-14T15:22:20.306 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-05-14T15:22:20.411 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls} duration: 953.4229629039764 failure_reason: 'Command failed on smithi002 with status 1: ''find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest''' flavor: default mon.a-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e mon.b-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e owner: scheduled_vshankar@teuthology status: fail success: false 2024-05-14T15:22:20.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T15:22:20.501 INFO:teuthology.run:FAIL